SSSSSSSSSSSS_ YYY YYY SSSSSSSSSSSS LLL 000000000 AAAAAAAAA 
SSSSSSSSSSSS_ YYY YYY SSSSSSSSSSSS LLL 000000000 AAAAAAAAA 
SSSSSSSSSSSS_ YYY YYY SSSSSSSSSSSS LLL 000000000 AAAAAAAAA 
SSS YYY YYY SSS LLL 000 000 AAA AAA 
SSS vYY YYY SSS LLL 000 000 AAA ABA 
SSS YYY YYY SSS LLL 000 000 AAA AMA 
SSS yyy yYY SSS LLL 000 000 AAA ABA 
SSS yyy yYY SSS LLL 000 000 AAA AAL 
SSS yyy yYY SSS LLL 000 000 AAA AAA 
SSSSSSSSS vYY SSSSSSSSS LLL 000 000 AAA AAA 
SSSSSSSSS vYY SSSSSSSSS LLL 000 000 AAA 
SSSSSSSSS vYY SSSSSSSSS LLL 000 000 AAA AAA 
SSS YYY SSS LLL 000 000 A 
SSS YYY SSS LLL 000 000 AAAAAAAAAAAAAAA 
SSS YYY SSS LLL 000 000 AAAAAAAAAAAAAAA 
SSS vYY SSS) LLL 000 000 AAA 
SSS YYY SSS LLL 000 000 AAA AAA 
SSS YYY SSS LLL 000 000 AAA AAA 
SSSSSSSSSSSS YYY SSSSSSSSSSSS LLELLLLLLLLLLLLL 000000000 AAA AAR 
SSSSSSSSSSSS vYY SSSSSSSSSSSS LELLLLLLLLLLLLL 000000000 AAA AAA 
SSSSSSSSSSSS yyy SSSSSSSSSSSS LLLLLLLLLLLLLLL 000000000 AAA AAA 
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cc 00 00 NNNN NN MM MM MM AA AA NNNN NN 

cc 00 00 NNNN NN MM MM MM AA AA WNNNN NN 

cc 00 00 NN NN NN MM MM AA AA NN NN NN 

cc 00 00 NN NN NN MM MM AA AA WN NN NN 

cc 00 CO NN NNNN MM MM AAAAAAAAAA NN 

cc 00 00 NN NNNN MM MM AAAAAAAAAA NN NNNN 

cc 00 CO NN NN MM MM AA AA WN NN eoes 
cc 00 00 NN NN MM MM AA AA NN NN eeee 
cccccccc 000000 NN NN MM MM AA AA WN NN weve 
cccccccc 000000 NN NN MM MM AA AA WN NN eeee 
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FACILITY: EXECUTIVE, CLUSTER MANAGEMENT 


ABSTRACT: 
This module creates and manages the cluster configuration. It is 
responsible for forming a cluster, adding nodes to a cluster, and 
reconfiguring a cluster following a failure. 


ENVIRONMENT: VAX/VMS 
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AUTHOR: David W. Thiel, CREATION DATE: 4-Apr-1983 
MODIFIED BY: 
v03-022 dWT0225 David W. Thiel 1-Jul-1984 
Change call to soagerery name EXESMNTVERSP2 to 
real name EXESCLUTRAN 
v03-021 DwWT0219 David W. Thiel 08-May-1984 
dd synchronizetion Settee 1/o and lock manager 
clusters. 
v03-020 pyroets David W. Thiel 17-Apr-1984 


Always fork at least once when locking. nodes to 
begin a state transition. Correc + He § for 
locking nodes when es allocation fails. 


v03-019 DWT0206 Thiel 08-Apr-1984 
borrect branch = YNasRevD RECONF 1G 
Tighten up timing on cluster formation to avoid 
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forming 7 tigen & cluster. Add CNXSPOWER_FAIL 
en eotre n ve control on over $v Feo" Sut 
Use LUBFKBSV_FKB_BUSY instead o BUSY. 
Fix method of comparing quorum d a cool from 
various nodes. 


v03-018 DWT0201 David W. Thiel 4-Mar-1984 
Remove temporary code defining new symbols in the CLUB. 
V03-017 DWT0194 David W. Thiel et r-1984 
Change agree? ce to disk quorum module glininate 
window of a b ROB Rename cue? QF $e P_READ tou 
DE. Update CSB$0_REFT Ine when a node 


ELUBSV QF ant D 
added fo or rémoved from the cluster. ng 
phose messages a subroutine. Hake addition/detetion 
of quorum disk from cluster a full two-phase transition. 
Support requests for quorum change. Remove propagation 
of some bits to all nodes of cluster. 
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GOOOCGCCCCOCOCSCOCOOOOOOOCOOOOOCOoOO 
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Modify use of CSBSB_NODEMAP to represent current 

best estimate of global rEce status. Bit 0 

is used for the quorum d ‘connection’’. this field 
is maintained for use by the optimal sub-cluster 
calculation. Do optima setey ation on cluster 
pesent? ucet tons and cluster formation. Always 

cooy tt ACTIVE bit to CSBSV_ACTIVE bit in 

CNXSDISK_ EMRNGEL Correct blown register. 


V03-012 DWT0147 avid W. Thie 19-Dec-1983 
Add support for ock mengger ge a leek vector. 
Remove old lock manager directory pysten 
ae cLuBse —, se quater membership Wan sequence 
mber) suppor for maintaining same. Add use of 
CLAPROSL. angen field and it propagation wi with phace 
messages. Use common routine CALC for 
all quorum calculations. Add support for @ variable 
number of votes ior the qyorus um disk. Remove suet ng 
in ote fal unused fields in the CLMSTS pease 
paves - in table on all cluster member 
Change name of C sty} wn PRILIN® and 
CNXSBEGIN PAL OVER to ERYSRENGERSHIP_CRAN ANGE. 
Use routines in new CONSUBS modu “Update TOPOLOGY 
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V03-016 DWT0187 David W. Thiel 5-Mar-1984 
9 Correct and improve random number time-outs. 
0 v03-015 DwWT0181 David W. Thiel 27-Feb-1984 
: Correct MULL3 to be MULL2. 
00 v03-014 DwWT0173 David W. Thiel 27-Feb-1984 
000 Start on recent teyretten attempts after some other 
8 00 meee al es and fails. Raise interval to 0...20 seconds 
00 hen request ing cluster membership. Correct use o 
00 CLUBSU. Syores to always atnterse — and to propagate 
00 when forming or adding nodes. 
CNXSSHUTDOWN, update dummy tiuxs cane e QUORUM.” 
. v03-013 DWT0161 David W. Thiel 03-Feb-1984 
0 
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message logic. 


v03-011 DWT0141 David W. Thiel 04-Nov-1983 
Correct decision of who is to bugcheck when two 
clusters meet. 


V03-010 DWT0136 David W. Thiel 04-0c t-1983 
Correct validation of transaction number in received 
woosege to compare against the current transaction 

than the maximum transaction number seen. 
Me ‘tlussy. LOST_ CNX to mark situations where there 
$s @ broken connection to a cluster member. 


v03-009 DWT0132 David W. Thiel 23-Sep-1983 
orrect o*ayee of register on an error path in 
CNXSREVD DESC. Improve state change messages to 
be less Fepetitious. 


V03-008 DwWT0128 David W. Thiel 30-Aug-1983 
e less narearee in received status when CLUBSV_INIT 
flag has not ye ; been set -- avoid attempting to join 
uster in this situation. 
Enable wr 4 ta quorum file when node is added to an 
existing cluster 


v03-007 eure — ph W. Thiel 22-Aug-1983 
oefner disk upper’. Change CONFIG_CHANGE to 
eaxs ONF IG CHANGE” Add logic to recover from a 
vetkure | whTle a cluster state transition is in 
progress. Add routines to process incoming QUORUM 
and TOPOLOGY messages. 


V03-006 DWT0116 David W 
Change a STD_RESP as cnn 
syene Lees PROCE 
CNXSPROCESS _REPONSE and mak 

Improve use of CLUBSL_TQE fiel 


Y03-005 DWT0111 David W. Thiel 28-Jul- otras 
Sytoneticott raise quorum to be greater than half 
. i dk 2, 9 eave lable votes. 
for random Siaeous fs. 
had ENXSCHANGE® QUORUM entry goin 
correct | Senet ng of status bits feeokued from a 
Hang if 9 quorum using CNXSCHECK_QUORUM routine. 


v03-004 DwWT0109 David W. Thiel 25-Jun-1983 
Select appropr late nodes when join me sooo is received. 
beter se otrectory eystes in join ng node 
until phase 2 message is received. 


V03-003 DWT0108 David Ww. Thiel 3-Jun-1983 
Fix broken BLBC instruction, Fix logic for Look ing 
up a node described in a message from a remote system. 


V03-002 DWT0106 David W. Thiel 23-Jun-1983 
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Ls ‘eH and make 
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Correct search fee CSB when node description received. 
joing tne clus pod on of directory node when a node 
ec 

eallocate aSPI B after a in DESCRIBE_NODE. 
When a connection breaks, disab ° lock$ and forbid 
additions of nodes to the cluste 

qerrest discrepancy in protecol for reqeusting membership 
na cluster. 


v03-001 DWT0103 David W. Thiel 27-May-1983 
Fix blown register. 
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-SEP=1 SYSLOA. SRC.JCONMAN.MAR; 1 
.SBTTL DECLARATIONS 
3 INCLUDE FILES: 


CORPDEF 3; CDRP {teets 

CDTDEF 3; COT Offse 

CLMORSDEF ; Cluster 4 Sconnect/reject codes 
sot Snseeee ; Cluster message | geet n 

CLUBDEF 3; CLUster Block offsets 
SCSBDEF 3; CSB Offsets 
SDYNDEF ; Data structure type codes 
te i ; Fork Block offsets 

IPLDEF 3; IPL definitions 
SPCBDEF 3; Process Control Block offsets 
SPDTDEF ; Port Definition Table offsets 
SSBDEF 3: System Block offsets 
SSSDEF 3 Status code definitions 
STQEDEF 3 TQE offsets 

: OWN STORAGE: 
-PSECT $$$040,LONG 3; R/W Data PSECT 
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; NOTE: The following assumptions are in effect for this entire module. 
S peececececccnscccececccnncenncenceeqnnncnencceseceoenncnceseeteeeenccess 


ASSUME IPLS_SYNCH EQ IPL$_SCS 
ASSUME IPLS"SYNCH EQ IPLS_TIMER 


-PSECT $$$100,LONG 
- DEFAULT DISPLACEMENT ,WORD 
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RO contains status. 
SIDE EFFECTS: 
Ri is destroyed. 
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-PSECT $$$002,LONG 
CNXSCON_INIT:: 
PUSHR 


Initialization Psect 
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you-000 CNXSCON INIT = Initial izacion call greeks basbesee Lereyoa. ceeScoNMANcgar:1 ase (8 
-SBTTL CNXSCON_INIT = Initialization Call 
p++ 
FUNCTIONAL DESCRIPTION: 
: This routine is called at system initialization to start up the 
; Fert ieuretten manager. This call must be made AFTER the CLUB 
: $s created and initialized. IPL is 31. 
; CALLING SEQUENCE: 
: JSB CNXSCON, INIT 
3 IPL is 3 
: INPUT PARAMETERS: 
0 : NONE 
09 : OUTPUT PARAMETERS: 
00 : NONE 
00 + COMPLETION CODES: 
09 
0 
00 
$0 
00 
88 
0 
i 
09 
0 
0 
0 


OOCOCCOCQOSCOooooooooooooooooooooooooooooooesoo |} 
FWSS FF HMMM OWOCOOCOCOCOOCSCOSOOCO COSCO OCOOCOSCOOOOOOOOOOOOOSoOO 
NAUSEA OOO NAMES WIN @ OO ONAU EW O OONAUE WR OOONOU 


BOON NNO AAA AA A AAA MAMIE BS BS BP IAAI AAAI OOD 


3¢—Cfs«éBB Renee R3,R4,R5> ; Save registers 
54 _00000000'GF D0 G*CLUSGL_CLUB,R4 : Address of CLUB 
00 1C AG 12 € BBSS § #CLUBS$V_RO_FORM, - : Set bit inhibiting cluster formation 
CLUBSL_FLAGS(R4S ,10$ 
53 10 A4 0 8 10$: MOVL rate’ LOCAL CSB(R4) -R3 3; Address of local CSB 
60 AS 02000008 8F C 1 BISL2 #<CSBSA_STATOS _RCVD ! - ; Mark status received 
1 CSBSM_QF_SAME>, - ; Mark quorum files matching 
1 8 tate STATOS(R3) : for local C 
a | ; 1 MOVZWL #FKBSR_LENGTH,R1 : Fork block Length 
FFEO' 1 0 SSB CNXSALCOZMEM ; Allocate and zero a block of memory 
11 E 1 BLBC RO, 3 Branch on error 
be ; MOVL R2,R 
OA AS MOVB #OYNSC_FRK, - : Block type 
A 4 FkBSB_TYPE(RS) 
0B AS) «6(08—o90 A 5 MOVB vip, ~scS, = 3: Fork IPL 
E § FKBSB_FIPL(RS) 
FFCF’ 38 . BSBW INIT_CONTINU 3; Put synchronous return on stack 
50 1 OD 8 MOVL $*ass =NQRRAL RO 3 Set success status 
: <R27R3,R4,R5> ; Restore registers 
C 4 279 208 POPR #*M<R27R3,R4,R5 R i 
5 § RSB 
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v04-000 CNXSCON_INIT = Init alization Call aes es B59: 38 SYSLOA.SRCJCONMAN.MAR; 1 8 (3) 
0000 «-PSECT $$$100,LONG 
INIT_CONTINUE: 
Q0000000'GF 16 ae G*EXESFORK ; Fork 
; Get here scon after IPL is lowered to SCS (8) at system initialization 
FFF7* 30 5 BSBW CNXSRANDOM_INIT ; Initialize random number generator 
009 ; Wait for SYSINIT to start up and declare us ready for think about forming a cluste 
0269 30 009 10s: BSBW CNXSSEND_ALL_STATUS ; Send status as necessary 
FORK_WAIT ; Wait a secon 
F2 1C AS 13 =«©€1 = «001 BBC #CLUBSV_INIT, = ; Branch if SYSINIT has not yet triggered us 
01 CLUBSL_FLAGS(R4) , 108 
PUSHR #*M<R4,R5> ; Save registers 


sc ; Look for work to do 
POPR #*M<R4,RS> ; Restore registers 


We must now delay an appropriate time before forming a ciuster in order to allow 
the discovery of other nodes that are already cluster members beyore attempting 
to form our own cluster. This time is the Larger of: 

a) SCS process poller interval + largest PDT polling sweep interval 

b) Time to find dan disk device and acquire a ‘'connection’’ to the 

quorum disk 

In fact, we ignore the Latter at this time. 
We do the wait in two steps. First we wait the process poller interval because 
this is known. Then we wait a time which is the maximum of the set bi sweep 
intervals of all ports that have been found during the earlier interval. 


MOVZWL G*SCSSGW_PRCPOLINT,R3 =; Process polling interval 
208: FORK_WAIT ; Wait a second 
BBS #CLUBSV_CLUSTER, - ; Branch if a cluster has been formed 
CLUBSL FLAGS(R4S ,608 
SOBGEQ R5,20$ 3; Wait for interval to complete 


: By now, all SCS ports should have been found. 
: Scan List of all cote computing the largest value of PDTS$L_POLLSWEEP that 
: s 


fo 
0 


BA 


00 
53 00000000'GF  3C 8 
32 1¢C A4 «6000~—C—ié*#ECO 09 
F2 53 F4 09 
0 
00 
83 ; can be found. s the interval that we should now wait before 

0 

0 


: ey a cluster, i.e. it is the interval that may elapse before a 
; connection may be made to an existing cluster node. 


AAA A AA NIPPPIDININIPIPIISI 3 | "QOODOOOOOCOOOOO0O0 0000 OMccecpcscpcN cD 
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534 CLRL RB : Accumulator for larger PDT$L_POLLSWEEP 
50 soeet'* ad’ D MOVAL Faas agent Or AO 3; Get address of PDT listhead 
5 60 0D C 30$: MOVL (RO),R 3 Link to next PDT 
OF 1 F BEQL 50$ ; Branch when all done 
53 0008 C D1 41 CMPL POTSL_POLLSWEEP(RO).R3 ; Is this value larger? 
05 18 rt BLEQU ; Branch if no 
53 0008 CO oD 4 MOVL POTSL_POLLSWEEP(RO),.R3 ; Update largest seen yet 
ED 11 rt 40$: BRB 30$ 3; Continue iteration 
4F 508: FORK_WAIT ; Wait a second 
08 1C AS «00 «£0 55 BBS #CLUBSV_CLUSTER, - 3; Branch if a cluster has been formed 
SA UB L FLAGS (R45 .608 
F2 33 F4 2A SOBGEQ R5,50 ; Wait for interve} to gonplete 
00 1C A&4s 1 —5 B BBCC #CLUBSV_NO_FORM, - : Clear formation inhibit 
6 CLUBSL_FLAGS(R4S ,60$ 
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RO 
Bat oe ANONPAGED 
SCAN 
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; Fork block addre 
: Deallocate fork 


; + Look for work to 
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Power Fail Recovery Ent SEP=1 SYSLOA.SRCJCONMAN.MAR; 1 (4) 
-SBTTL CNXSPOWER_FAIL = Power Fail Recovery Entry 


aor 
z 
xa 
An-— 
vc 
ow 
ge 
me 
z-7 


p++ 

: FUNCTIONAL DESCRIPTION: 

This Ay hopes is called during recovery from a power failre. 
IPL is 31. 


CALLING SEQUENCE: 


JSB paeatemeess dias 
IPL is 3 


INPUT PARAMETERS: 
NONE 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
ALL registers are preserved 


CNXSPOWER_FAIL:: 
POSHR 


SIND DDD DD DDD PAPA AAA AAA AAA AAA OA OO 


38 7 #*M<R3,R4,R5> 3; Save registers 
54 90000000" GF D MOVL  G*CLUSGL_CLUB,R4 : Address of CLUB 
55 018C C4 i MOVAB CLUB$B CCUBPWE(R4).R5 =; Fork block address 
0218 AS 00 €E BBSS #CLUBPOF $V - :; Branch if block is in use 
UBPWFSL_STATUS(RS) ,10$ 3; by a previous power recovery 
03 10 BSBB $ 3; Save synchronous return address 
38 Be 10$: POPR #*M<R3,R4,R5> ; Restore registers 
5 RSB 3; Return to power fail notification code 
00000000 ' GF 16 20$: JSB G*EXESFORK ; Fork to IPL SYNCH, SCS 


: Continue here at IPL 8 


BBCC #CLUBPWFSV_BUSY 


2018 AS 00 ES - 
CLUBPWFSL_STATUS(RS) ,60$ 


; Clear busy bit, branch on error 


~©. 02.00 09.00 0d 00 Od Co Co Co 
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00 1C AG «1E~ ES 9 1 BBCC crises Q pymyorg - ; Clear bit counting disk in dynamic quorum 
09 : CLUBSL_FLAGS(R4) , 308 
00 1¢ AS) 6«618—SCOE2 9 30$ BBSS ertuS QF FAILED NODE, - ; Trigger quorum disk manager to reacquire 
4 CLUBSL_FLAGS(R4) ,40$ 
52. 1C_ AG 5 40$ MOVL eL USS FLAGS(R4),R ; Save flags 
FFSE* $ BSBY CNX EHECK QUORUM 3 Check for out of quorum condition 
52 1 A4’ CA A BICL2 CLUB , FLAGS (R4) » ; Set flag in R2 if clear now and set earlie 
* | A 38 BBS #CLUB V_GUORUM.R2, os ; Grenes f querus was just lost and mntver 
: riggere 
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Q0000000'GF 16 AA & 9 JSB G*EXESCLUTRANIO ; Throw disks vate mount verification to ens 
B 4 ; all disk 1/0 is blocked, pending resolut 
4 g 3 the status of the cluster 
05 : c ? 50$: RSB 
a8} Z 4 60$: BUG_ CHECK CNXMGRERR,FATAL ; Multiple use of fork block 
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-SBTTL CNXSCON_NEWSYS = Connected to New System 


aa 
+ 


FUNCTIONAL DESCRIPTION: 


forming a cluster, 
this system is a member. 
CALLING SEQUENCE: 


JSB CNXSCON_NEWSYS 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
R5: CSB of new system 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO and R1 are destroyed 


NXSCON_NEWSYS: : 
PUSHR -#*McR2,R3,R4,RS> 


BBCS $ #CSBSV_SEND STATUS, - 


CSBSL_STATUS(R3),10$ 
START- TIMEOUT 
POPR #*M<RZ,R3,R4,R5> 


a 
o 
Sad 
@ 
n” 
@ 
< 


This routine is called when a connection to a new system is 

made, It will — status with the new system and consider 
oining the cluster of which the new system is 

a member, or wait for the new system to join the cluster of which 


; Save registers 
; Put CSB address in R3 
; Need to send status 


; Start CLUB-based timer 
; Restore registers 
; Return 
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~SBTTL CNXSCON_BREAK = Connection has broken 


+ 
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FUNCTIONAL DESCRIPTION: 


This routine is called when a connection to a system has broken and 
attempts to reclose the connection have failed. 


CALLING SEQUENCE: 


JSB CNXSCON_BREAK 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
R5: CSB of system to which the connection is lost 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO and R1 are destroyed 


CNXSCON_BREAK: : 
PUSHR 


BB #*M<R2,R3,R4,R5> : Save registers 

D 3 : Put CSB address in R3 
DO MOVL  CSBS$L_CLUB(R3),R4 : Address of CLUB 

9E MOVAB CLUBSB_CLUFCB(R4).R5 : Address of CLUFCB 


REANI SO OO NOME WN SO OD NAMES WIN 9 OO NAME WO OONOAUE 


OOOO O0 OOOO O09 09 69 09 69 09 09 09 09 09 SI NIN NSIS SIN NPAAAAAAAAA MMIII 


22 60 AS =(O1 sa BBC #CSBSV_MEMBER, - ; Branch if lost node is 
CSB$L_STATUS(R3),10$ =: not a cluster member 
1C AS 00800000 BF C8 BISL2 #CLUB ST_CNX, = 3; Mark connection to member Lost 
0 CLUBSL FLAGS (RG) 
00000000'GF 01 E MNEGR # guutk GB_STALLREQ : Stall lock requests 
30 4C As : MOVZWL CSBSW_CSID_IDX(R3),RO : CSID index value 
00 AS 5 E BBCC RO, = 3; Clear participation bit in 
CLUFCBSB_NODEMAP(RS).5$ ; failover table for lost node 
51 10A4 OD 3 5$: MOVL chuest LOCAL_CSB(R4),R1 ; Local node CSB address 
00 008C ci 50 € 108 BBCC RO,CSBSB_NODEMAP(R1),10$ ; Mark loss of connectivity from local node 


32 1¢ AS «61D~C*é‘#é@é‘*SN 
10 AS «=5C ASCO 
1F 


BBC #CLUBSV_TRANSITION, = ; Branch if no state change in 
CLUBSL_FLAGS(R4), éos_—: progress 
CMPL CLUBS$L_COORD(R4) 3 Is this node the coordinator 


CLUBSL LOCAL _CSB{R4) 
BEQL 4 ; Branch if this node is the coordinator 
: Here if transition is in progress and this node is not the coordinator 


Pee a ala alta ot ot ot ot ot at ee MUM MUMUMAMMMAMAMAAMAAAAMMeaee eee eee 
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53 «5C AS CMPL BSL_COORD(R4) ,R3 3; Is connection to coordinator lost? 
28 3 ° BNEQ hy - : Branch 9 not coordinator connection 


3; The connection to the cgoréingter has been lost and this node is in the midst of 
; a cluster state transition. If a Phase 1 message has not yet been received, it is 
; safe to back out the transition because we know that noone can have seen a Phase 2 
3; message. 
CMPB CLUBSB ‘ty PHASE(R4S), = ; Has Phase 1 been seen yet? 
#CLACNRSK_PH1 
BLSSU 3 ; Branch if no Phase 1 yet 


: This node has received a Phase 1 message. If this node is not a member of a 


40 8F SPAS 91 
OD =F 


; cluster, then bugcheck -- we can't cleanly resolve what might be happening. 


04 1C AG 00 €1 BBC #CLUBSV_CLUSTER, - ; Branch if not a cluster member and 
CLUBSL_FLAGS(R4S ,20$ ; _ resolve the situation the easy way 
1D 10 BSBB ANALYZE _PHASE ; Make complex decision about what to do 
18 #11 BRB 70$ 
: This node is not a member of a cluster, is in Phase 1 of a cluster state transitio 
3; and has lost the connection to the transition coordinator. It is not trivial 
; to resolve this situation. Take the easy way out. 
20$:  BUG_CHECK CLUEXIT,FATAL ; Can't handle this failure case 
112330 $0$: BSBW UNLOCK. ALL : Unlock things 
11 BRB 0$ 
40$: 
: Here if transition is in progress and this node is the coordinator 
60 8F S9 A4 91 ; CMPB CLUBSB_CUR_PHASE(R4), - ; Has Phase 2 been sent yet? 
#CLMCNRSK_PH2 
1 BGEQU§ 50$ ; Branch if phase 2 sent 


05 
00 1C AS «611—té=é€E. BBCS #CLUBSV_UNLOCK ; No phase 2 sent -- request 


CLUBSL.FLAGS(R4), 50$ ; unlock 
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50$: 
; Common exit routine 
0431 30 0s: BSBW ss SCAN ; Start CLUB-based timer 
C Be 0$: POPR #*M<R2,R3,R4,R5> ; Restore registers 
5 RSB 3; Return 
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~SBTTL ANALYZE_PHASE = Determine Transition Phase and Finish Transition 
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FUNCTIONAL DESCRIPTION: 
{hte rous ine is called when all of the following are true: 
r 


) e local node is a member 9 a cluste 
$} A cluster state transition is in cee 

) The connection to the coordinator node has broken 
4) A Phase 1 message has been received 


This routine must determine whether to commit or backout the transition. 
CALLING SEQUENCE: 
JSB ANALYZE _PHASE 
IPL is nm scs 
The caller Ts returned to synchronously, but the function portersed 
e 


continues asynchronously and no notification is given to the caller 
upon completion. 


INPUT PARAMETERS: 


SNA AAA AAA AAA MINION 
OOO NAUE LO OONOAUM 


R3: CSB of system to which the connection is lost 
R4: Address of CLUB 


OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO through R5 are destroyed 
ALGORITHM: 
The strategy here is to poll all remaining cluster members and 
see whether they can resolve out dilemma. 
If another member has: 
Not yet seen Phase 1 ==> Undo the transition in progress 
Already seen Phase 2 ==> Commit the transition in progress 


Seen Phase 1 and has a coordinator connection ==> Restart poll 
Seen Phase 1 and has no coordinator connection ==> Continue poll 
h 


WO0O00000 00000000900 0000 CD CD COCO 


OOO NAUNEWIN $9 OOO NIA EWI  O OONOUE WN O 


If this completes without yield a definitive (Undo or Commit) result, 
poll all nodes again. If another member has: 
Not yet seen Phase 1 ==> Undo the transition in progress 
Already seen Phase 2 ==> Commit the transition in eroprecs 
Phase | and has a coordinator connection ==> inconsistent with above 
Phase 1 and has no coordinator connection ==> 
Obtain promise from node that it will never commit this 
transition 
Continue poll 


LE NINIAWINIAIAIAIAIUI IAI AINA AAI NIA ANIA AINA AWWW ANIA WII AAAI WII AINA AIA 
i i i i NB BB i i be 
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V04-000 ANALYEE PHASE ~Sbeternine Transition Pha ‘ScSEPa1984 Be:Boi5s LeNSVOR. ees NOC Oans: | hase 13, 
137 1 3 If this completes without yielding a definitive ‘Undo or Commit) result, 
! i : do not commit the transition. 
137 Sie 
137 19 ANALYZE _PHASE: 
1C A& 00100000 8F CA } 613 BICL hire tert 3; Clear backout inhibit bit 
1C AS 00000100 8F CA iF 4 6 : 10$: BICL2 Cam ; Clear polling phase flag (Phase A) 
1C A4 O00001E00 BF CA \of 3 § 20$: BICL2 CCUBSH. sts. on 3 Clear eo. result bits 
: ase 0 see 
14F 3 4 CLUBSM_STS_P PHY 3 phase seen (good coordinator connectio 
14F 625 CLUBSM-STS~PH1B. !- : phase 1 seen (broken coordinator connect 
14F 66 § CLUBSM_STS_PH2>, - 3; =phase 2 seen 
14F 6 BSL-FLAGS (R45 
SA AG 14F 6 8 CLRW $W_MSGCNT(R4) 3: Initialize waiting count 
FEAB’ 30 13 6 BSBW CNXSSCAN_CSBS ; Iterate over a SBs 
4D 5 E9 B12 630 BLBC R ; Branch when done 
18 60 A3.—s«O01 158 631 BBC acsBs ; Branch if not a member 
150 6 g ESBaL ISTATUS AS) 30$ 
1360 AS 00 €0 015d 6 BBS #CSBSV_LONG_BREAK ; Branch if permanent break 
162 634 CSBSL STATUSCR ), 40s : im connection 
OE 60 AS 18 €0 016 635 BBS #CSBSV_LOCAL 3; Branch if local CSB 
16? 636 CSBSL STATUSCRS) 30$ 
FE96" 30 0167 637 BSBW CNXSACLOC_WARMCDAP_CSB 
950 E9 OQO16A 638 BLBC 4 3; No ponory available 
AAS B6 016D 639 INCW UBSW_MSGCNT(R4) 3: Include in wait count 
07 10 O17 640 BSBB 3: Interogate node 
FE8B" 31 Bie o3) BRwW CNXSSCAN_CSBS_FORK ; Release control mementarily 
05 0175 etz 30$: RSB ; Return and continue scan 
FE87° 31 O18 oh? 40$: BRW CNXSSCAN_CSBS_RETRY ; Delay ard resume scan 
aI gi? | : Send status inquiry to one node 
50 OE 9A 0179 649 80S: MOVZBL @CLMCNXSK_FNC_TRNSTS,RO ; snch specific message code 
04 1C AS (08s? Ht 4 930 BBC BOLUS SN STS SENSE A” ; Branch if status inquiry phase A 
50 18 €E2 0181 $36 BBSS #CLACNESV_RP_ FANgts: wah 3 _nogueat commitment on Rag status 
96 184 65 © go into message rept field 
118A 3 185 654 60$: BSBW INIT MSG © eaendeed CDRP message initia ization 
FE75' : 8 $2 BSBW ENXSSEND~ “MSG_CSB : Send message 
1 637 : We are resumed here when the response message arrives. 
1 8 3 Registers contain 
1 659 ; R Status 
1 0; Re: Address of message buffer 
1 61; R35: Address of CSB 
1 5 : R4: Address of POT 
; 6 4 : R5: Address of CDRP 
1138 30 1 é 5° BSBW CNXSPROCESS_RESPONSE y Reoliscete s storage, get status 
14 5 E 13 96 BLBC ; B WACK or Sonne tion broken 
19% 66 ASSUME CLACNXSK_ RP_TRNSTS_PH +1° EQ CLACNXS$K_RP TRNSTS P 
191 668 ASSUME CLMCNXSK-RP-TRNSTS_PH1B+1 EQ CLMCNXSR_RP_TRNSTS_ PHI 
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191 9 ASSUME CLMCNXSK_RP_TRNSTS_PH1+1 EQ CLMCNXSK_RP_TRNSTS_PH2 
131 $76 ASSUME CLUB$V_STS_PH “y €G CLUBSV_STS PHiB ~ ~ in 
191 7 ASSUM te tte Ue B+1 EQ CLUBSV_STS PH 
191 or¢ ASSUME CLUBSV"STS"PH141 EQ CLUBSV_STS_PH2 
50 134A 9A 0191 67 MOVZBL CLACNASS REPLY(R2),R 
50° Q1 C2 0195 67% SUBL2  #CLMCNX$R_RP_TRNSTS_PHO Rg : Base on zero 
04 §0 01 198 679 CMPL RO, #CLMCNRSK-RP_TRNSTS_PH2 : Check range 
1A 01 6 BGTR 8 ; Out of range reply, die 
50 2 £8 19D of ADDL ott STS_PHO,RO 3 Compute bit number in CLUB 
00 1 A4 ee ys ors : BBSS R »CLUBSL_FCAGS(R4) ,70$ 3; Set status bit for this node 
1A 0 : terminate threads -- except for the Last one 
SA AG 6B7 (OIA : 70$: DEC SLUBSU_MSGCNT(R4) 
05 19 Q1A8B 6 BLSS $ ; Branch when done 
05 i~ ? : 8 : Terminate thread 
WP ? § 80S: BUG_CHECK CNXMGRERR,FATAL ; Inconsistent message data received 
1AF 6688 : Get here after all available member nodes have been polled. 
pir ret : Evaluate results of the poll and take appropriate action 
50 1C AS DO OIAF 691 908: MOVIL CLUBSL_FLAGS(R4) ,RO : Get Lb bits for easy handling 
0850 09 €1 0183 69¢ Bac #CLUBSV_STS_PHO,RO.100$ : Branch if Phase 0 not seen 
04 50 OC + 187 = 69 BBC #CLUBSV_STS_PHZ,RO,100$ ; Branch if Phase 2 not seen 
FE42? 30 018B 694 BSBW  CNXSBUGCHECR_CLUSTER ; Phase 0 and Phase 2 were seen -- die! 
05 135 022 RSB 
03 50 09 4 O16 $99 100$: BBC #CLUBSV_STS_PHO,RO,110$ ; Branch if Phase 0 not seen 
1080 1 t 038 BRW UNLOCK_ALL ; Some node was in Phase 0 -- Bail out andr 
— a bee $00 110$: BBC #CLUBSV_STS_PH2,R0,130$ ; Branch if Phase 2 not seen 
03 50 14 5° 1CA 80701 BBS #CLUBSV BACKOUT .RO. 1208 : Branch if we have commited to bach ing out 
OF 37 1 Ice 4 BRi DO_PHASE ; Pretend a phase 2 message has arrive 
ard ope 120$: BUG_CHECK CLUEXIT,FATAL ; Saw phase 2 after commiting to backing out 
OA 1C AS) «6(08—COE2 ips 7 $ 130$: ®BBSS #CLUBSV_STS_PPHASE, - ; Set polling phase B and do it 
IDA g f CLUBSL_FLAGS(R4) ,150$ 
IDA £09 : Polling phase A just completed 
03 50 1 OIA 711° BBC #CLUBSV_STS_PH1,R0,140$ ; Phase 1 with good connection not seen 
FF 5 i 195 ue RW 10$ ; Repeat first Boll ing phase 
FF6 1 +4 ay 140$: BRW 20$ : Perform second polling phase 
0450 OB €1 O164 715 1508: 68BC #CLUBSV_STS_PH?,RO,160$ ; Phase 1 with good connection not seen 
1E8 at BUG_CHECK CNXMGRERR,FATAL : Consistency error -- node with good connec 
H 4. ; seen during polling phase B 
1057 «31 «=(O1EC a 160$: BRW UNLOCK_ALL ; Second phase was unconclusive, back-out 
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-SBTTL CNXSDISK_CHANGE = Quorum Disk Connection State Change 


+ 
aa 


FUNCTIONAL DESCRIPTION: 


This routine is called when the “connection” 
or has been re-established. 


CALLING SEQUENCE: 


JSB CNXS$D1SK_CHANGE 
Kernel mode, IPL-.le. IPL$_SCS = IPL$_SYNCH 


INPUT PARAMETERS: 
NONE 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO ard R1 are destroyed 


to the quorum disk has broken 


SNA AAA AAA AAA AAI AA AAAI ES BS BE NAA AMA MA CLATINIPONINININONIND 
WO ODNAUE WINS ODNAMNE WN OOD NAVE WN OOD NAME WO ODNAUE WN Mma. 


SSNS eee eee ee eee ew wT ws z 


CNXSDISK yr le 
SSBINT #IPL$_ SYNC 3 Save and raise IPL 
PUSHR #*M<R2,R3,R4,R5> : Save registers 
VL 5*CLUSGL_ CLUB, R4 3; Address of CLUB 
MOVL CLUBSL LOCAL ES8cnu>, R3 ; Address of local CSB 
EXTZvV #CLuB$?_a ; Extract quorum file active bit 
CLUBSL_ renee nase RO” : . from CL 
INSV 3; Insert quorum file active bit 
ee QF _ACTI E. #1, - : extracted from CLUB into the 
csest paly S(R : _ local CS 
BSBW SSCAN_CSBS : Iterate over alt CSBs 
BLBC RO ; Branch when don 
BBSS RO, 308 SEND_STATUS, = ; Set status ronuset bit 
CSBSL_STATUS(R3) 208 
20$: RSB 
30$: BSBW CNXSCHECK_QUORUM ; Hang if necessary 
BSBW N 3; Look for work to do 
POPR #*A<R2,R3,R4,R5> 3; Restore ceptaters 
ENBINT ; Restore | 
$8 ; Return 
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0514 10$: 
50 9 
C 20$: 


CNXSCHANGE QUORUM: : 
PUSHR 
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-SEP-1984 SYSLOA. SRC 
~SBTTL CNXSCHANGE_QUORUM = Adjust quorum 


CONMAN.MAR; 1 


> FUNCTIONAL DESCRIPTION: 


spec value. This requires a full cluster state 
transition to agree on a new value. The value is 
adjusted so as not to leave the cluster without a 
quorum and so as not to risk per tt teneng given a 
universe of the nodes currently in the cluster. 


Request that the cluster quorum be updated to a 
j 


CALLING SEQUENCE: 


JSB _CNXSCHANGE_QUORUM 
IPL is IPL$_SCS 


The requestor can determine that the eperetes isc lete by 
ot ling the CLUBSV_ADJ_QUORUM bit in the CLUBSL_FLAGS word. 
his bit is cleared after the quorum has been adjusted. 


INPUT PARAMETERS: 


R1 is new quorum value 


OUTPUT PARAMETERS: 


NONE 


COMPLETION CODES: 


RO is success status. 


SIDE EFFECTS: 


R1 is destroyed. 


#NERZ-RS-RG,RS> 


CLRL 
MOVL  G*CLUSGL_CLUB,R4 

BBS #CLUBSV_TRANSITION, - 
cLUBSL FLAGS (R4) , 208 
#CLUBST_A 


Save registers 
Assume failure 
Address of CLUB 


BBSS DJ ougnus - 3 Set quorum update request bit 
CLUBSL_FLAGS(R ),20$ ; _ branch if already set 

MOVW R1, - 3; Store requested quorum value 
CLUBSW_ADJ_QUORUM(R4) 

BSB SCAN Look for work to do 


@ 
MOVZWL #SS$_NORMAL ,RO 


Return success status 
POPR #*M<R2,R3,R4,R5> 


Restore registers 
Return 


re i 


Branch if a state change in progress 
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~SBTTL CNASSHUTDOWN = Request cluster shutdown 


p++ 
$ FUNCTIONAL DESCRIPTION: 
This entry point is called to request a cluster shutdown. 
While in shutdown mode: 
No nodes may join cluster. 
If quorum is lost, shutdown immediately. 
When all systems reac shutdown state, shutdown this node. 
CALLING SEQUENCE: 


JSB CNXSSHUTDOWN 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
NONE 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
RO is success status 
SIDE EFFECTS: 
Ri is destroyed. 


CNXSSHUTDOWN: : 
PUSHR #*M<R2,R3,R4,R5> 
MOVL  G*CLUSGL_CLUB,R4 
MOVL CLUBSL LOCAL_€SB(R4),R3 
BBSS  #CLUB$Y_SHUTDOWN, - 
CLUBSL_FLAGS(R4) , 40S 


Save registers 

Address of CLUB 

Local system CSB address 
Set shutdown mode in CL 
and branch if errgety pee 


BBSS #CSBSV_SHUTDOWN, - Set shutdown mode in 
CSBSL_STATUS(R3),20$ 
20$ SPW CHXSSCAN_CSBS ; Iterate over all CSBs 
BLBC RO,4 : Branch when done 
BBSS #c§B$V_SEND sratus -  ; Request that status be sent 
6 CSBSL_STATUS(R3) , 30S 
30$: RSB 
79 408: BSBW SCAN ; Look for things to do 
MOVZWL #SS$_NORMAL RO ; Return success status 
iM #M<R2,R3,R4,R5> 3 poetere registers 
; Return 
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FUNCTIONAL DESCRIPTION: 
This routine is called to send our status to all systems 
for whom the send status flag is set. 
The routine returns synchronously, status will eventually 
et sent or the Link will break and the status will never 
e sent. 

CALLING SEQUENCE: 


JSB ty de ALL STATUS 
Tet is IPL$_SCS 


INPUT PARAMETERS: 
NONE 
OUTPUT PARAMETERS: 
R4 is address of CLUB 
COMPLETION CODES: 
RO 
Success (even): Status will be sent or the Link will break 
Failure (odd): Status cannot be sent, probably because storage 
cannot be allocate 
SIDE EFFECTS: 


Ri is destroyed 


AAA NIAA MIA IPPIPONRINININININIDS 3 9 MQOOOSCOOOOCOCOCOOOOOOOOOOWAdCCDCDOD W-n 
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CNXSSEND_ALL_STATUS:: 
PUSHR gMcR2, R3,R5> : Save registers 
MOVL oR : Init for" ¢3b status 
BSBW Cui os CSBS ; Look for CS Pris ite, status 
BLBC 3; Branch when done 
BBS acsesv gf ONG BREAK ; Ignore ne as Tas permanently 
cB BS SS ATUS (RS d. {08 : connectio 
BBC Vs Tus 3; Branch if status not requested 
CSB8L STATUSiRS). és” 
BSBB SEND _STATUS 3; Queue status message 
BLBS RQ, 3; Branch on success 
MOVL R *R ; Save status 
10$: RSB 
208: MOVL R5,RO0 3 Fetch status 
POPR #*M<R2,R3,R5> : Restore registers 
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Return 
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-SBTTL SEND_STATUS = Send Status to a System 
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FUNCTIONAL DESCRIPTION: 
This routine is called to send our status to a system. 
The routine returns synchronously, status will eventually 
et sent or the Link will break and the status will never 
e sent. 

CALLING SEQUENCE: 


JSB SEND_STATUS 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
R3: CSB of new system 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
RO 
Success (even): Status will be sent or the Link will break 
Failure (odd): Status cannot be sent, probably because storage 
cannot be allocated 
SIDE EFFECTS: 
R1 is destroyed 


Sete Se Ge Ge Ge Ge Ge Ge Ge Se Ge Ge Ge Ge Ge Ge Ge Ge Ge Gets Ge Ge Ge Ge Sse Ge Ge Ge Ge Ge Ge Ge 


SEND_STATUS: 
PUSHR #°M<R2,R3,R4,R5> 
BBS #CSBSV_LO AL - 
CSBSL_STATUS(R3) ,20$ 
BBS #CSB$0_LONG BREAK . 
csBsL STATUS(RS) , 20$ 


Save registers 
Skip if vocal system 


Skip if long break 


BSBW NXSALLOC_CDRP_ONLY 

BLBC 3; No memory available 

MOYAB 8B* puto STS_MSG, = 3; Address of routine to build 
CORP L_ASGBCD(R5) ; status message - 

BBCC $V_SEND_STATUS, - ; Clear “send status’ request 
CSB$L_STATUS(R3), 10$ 


; Setup immediate return 

; Address of CS 

; Sending status message text 
this state known 

; Return success 

; Restore registers 

; Return 


$_MSG,RO 
AFIG CHANGE 
$*#SS -NORAAL R 

BOM<R27R3,R4RS> 
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-SBTTL BLD_STS_MSG = Build Status Message 
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3 ++ 
: FUNCTIONAL DESCRIPTION: 


This routine builds a status message describing the local node and the 
cluster of which it is a member. 


CALLING SEQUENCE: 


JSB BLD_STS_MSG 
IPL is IPL$_SCS 


INPUT PARAMETERS: 


R2: Address of message buffer 
R3: Address of CSB 
R4: Address of POT 
RS: Address of CDRP 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 


SIDE EFFECTS: 
RO and R1 are destroyed 


i+: DTP e Tee Tee Tee rere rere rerererererererererererererere ry 


SOOOCOGOCOOCOOCOOSOOOOCOCOOOOOSOSSOOOOSOOOOCOSCOOOOOOOOOOCOOOOOOOOOOOOO 


WM HW HMMMMMM MMS SOS OP ONO NAAAAOHAAAAAAAAAAAAAOAAAAOOOQAOAAAOMOAOAO 
COW Th DS PAA 9 FD OU $$ FF OOOSODOOOODOOODOODODOOOOOOOVOOODOO00000O 


08 A2 01 90 UILD STE ONB SCL SASESK FAG EMM : Facility identifier 
09 A2 «01S: 90 MOVB FO Naee FMC A EIATUS. - ; Facility specific function code 
1 8 mus ASC R,  stécenet UR 

04 1C Al 0 E1 B crt usey CLUSTER, 108 : Branch if bit not set 
OC A2 01 «88 BISB #CLASTSSA, CLUSTER, - ; Set bit in message 

04 1C Al O01 1 10$ BBC eel UB SV UE ACTIVE, 1¢ : Branch if bit not set 
Oc a2 02 88 BISB EtReY SSB FABER. - ; Set bit in message 

04 1C Al O02 €1 20$ BBC erie Oy SHULD ON 5s ; Branch if bit not set 
OC A2 (046 = 88 BISB CLRETSBB FLAGS(RE) - ; Set bit in message 

OF A2 20 A1~ B60 30$ MOVW Te LR ; Cluster quorum 

10 A222 Als: BO MOVW CLuas VOTESCRT) « ° ; Cluster votes 


CONMAN = Cluster Configuration Manager 16-SEP-1984 00:26: AX/VMS Macro V04-00 Page 
v04-000 BLD_STS_MSG = Build Status Message $7$EF 71382 8:69:39 SYSLOA.S Rese CONMAN.MAR; 1 ~ B) 
FD 1055 tet ee CVOTE (R2) 
12 A2 24 A1- B80 FD 1 § MOVW CLUBSW_NODES(R1) ; Cluster nodes 
1 eLastssu NODES(R3) _ 
39 10 Al OD 1 § MOVL CLUBSL_LOCAL C58(R1) RO ; Address of local CSB 
14 A 52 40 8B i MOVW CSBSW vo DORUATR ),- 3 Node quorum 
B 1 p cms T Su NQUORUM{R2) 
16 A2 50 A0 860 1 MOVW cse$w yOTES RO), - 3 Nodes votes 
10 1 3 CLMSTS$SW NVOTES(R2) 
1¢ A2 2C Al 7D 10 1 ? MOva CLUBSQ_FTIME(R1), = ; Cluster formation time 
15 1064 CLMSTSSQ_FTIME(R2) 
24 A2 3C Al 7D 15 1065 MOVa CLUBSQ_LST_TIME{R1), - ; Time stamp of Last transaction 
1A 1 6 CLM 7380 LST_TIME(R2) 
18 A2 56 A0 80 1A 1 MOVW CSBSW_QDV0TES(RO), - ; Quorum disk votes proposed by local 
1F 4 8 CLMSTS$W_QDVOTES(R2) =: node 
1A A2 54 A0- 860 FO MOVW CSBSW LERDIRWT (RO) S'o9 Lock manager directory system weight 
4 1070 CLMSTSS$W_LCKDIRWT (A2) 
2c A2 «68 Al C=O 4 1071 MOVL CLUBSL_MAX_XTN(R1), - ; Largest transaction code 
9 1 fe CLM MSTSSL X_XTN(R2) ¢: seen 
40 A2 74 A0 7D 9 107 mova CSB$a REFTIME(RO) - ; Put local reference time into message 
O32E 1074 eLNSTSSa REF TIME (R2) 
3¢—COfs«wBB 9 1075 PUSHR #*M<R2,R3,R4,R5> 3 Save registers 
30 a2 0088 C1 ~«10~—iB 3 1076 MOVC3 AcLngt S88 Obi sk - : Quorum disk name 
HF 144 BST _QDNAME (RI) 3 from SYSGEN parameter 
3 1 A: CLR nsts88 aDISK«R2S 
3¢—Cfs«&BBA 7 107 POPR #*°M<R2,R3,R4,R5> ; Restore registers 
05 0339 1080 RSB 
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v04-000 CNKSREWD. STATUSSS Stacus Received from a S-SEPo19Be OusO 29 Pee BS Cees ONGAN Bans: 29° (92, 
i ] 4 -SBTTL CNXSRCVD_STATUS = Status Received from a System 
A joes 3° 
A : ; FUNCTIONAL DESCRIPTION: 
A 1 8 : This routine is called when a status message is received. 
A 1 3 Data re the message is copied in the CSB. A cluster 
A 1090 ; transition may be initiated as a result of seeing the 
: } 4 ; message. 
A $8 ; CALLING SEQUENCE: 
A 1095 : JSB CNXSRCVD_STATUS 
{ 38 : IPL is iPL$_SCS 
3A 38 ; INPUT PARAMETERS: 
A 1100 : Re: Message address 
A 1101 ; R3: CSB of sending system 
. i § : PDT address 
A 1 : : OUTPUT PARAMETERS: 
A 1106 ; NONE 
A 1108 > COMPLETION CODES: 
A 1110 ; NONE 
A 111g : SIDE EFFECTS: 
A 1114 ; RO-RS may be destroyed. 
a EE 
A 119 CNXSRCVD_STATUS:: 
55 53 00 A 148 AOVL R3,R 3; Address of CSB 
50 0000'°CF 43 D 111 MOVAB RCVSTS_MSG,RO 3: Sending status message text 
FCBB 42 1120 BSBW CNXSCORE 16_CHANGE ; Make this state known 
O¢ ce 45 1121 PUSHR #*M<R2,R35> : Save needed registers 
54 64 A383 D 47 11 : OVL  CSBS$L_CLUB(R3),R4 : Address of CL 
60 A3 00000700 BF CA 4 8 ? BICL2 #<CSBSM CLUSTER ’ : Clear out received status bits in CSB 
1125 CSB5R_ SH TDOWN>, - 
11 § CSB$L_STATUS(R3) 
05 0C A2 00 €1 ; 11 BBC eCLnS Ts CLUSTER, - :; Branch if bit clear 
11 : CLMSTS$B_FLAGS(R2),1$ 
00 60 AS 08~ €E2 5 11 BBSS #csesv_cCusTerR, - ; Set bit in CSB 
3 1130 CSB$L_STATUS(RS) ,1$ 
05 0c A201 Cé€é#* 1131 1$ BBC SCLMSTSS$V_QF active - ; Branch if bit clear 
62 11 : CLMSTS$B_FLAGS(R2) ,2$ 
00 60 AS 09 €E2 62 11 BBSS th gg oF Ot AyF: - 3; Set bit in CSB 
67 11 : CSBSL_STATUS(R3) ,2$ 
05 0C A2 O02 €1 7 #11 es} BBC ecLnsT sev SHUTDOWN, - ; Branch if bit clear 
oe § CLMASTS$B_FLAGS(R2) ,3$ 
00 60 AS OA C2 ¢ 11 Bess aCSBSV shu Dowy Sad ; Set bit in CSB 
1 1138 CSBSL_STATUS(R35 ,3$ 


30$: 


6— 10 Ad «613—i*#EY 
05 60 AS 01 «CE? 


Branch to exit if initialization 
leg is not yet set 

Branch if remote node is not 

a member of the local cluster 


BBC #CLUBSV_INIT, - 
CLUBSL_FLAGS (R4) , 3008 


BBC #CSBSV-MEMBER, - 
PSBSL STATUS CAS), 1008 


SVIOVGOMOMOAOOQOQAOOAOAAO 


: The local node is part of an existing cluster. 
§ 3 Update quorum calculation to reflect any ehenay seen by the remote node, 
3; for example a change in status of the quorum disk. 


BSBw CeeRCe CeCe : Perform dynamic quorum check 
BRB 00$ 


100$: BBC #CLUBSV_CLUSTER, - ; Branch if local node is not 
CLUBSL_FLAGS(R4S, 2008 : a cluster member 


; Local node is a cluster member. 


FC24" 30 
64 =O ; Branch to common exit 


40 1 A4 «=600-tsé#€C*Y 
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v04-000 CNKSREND. STATUS eS Status Received from a moet 90:89:38 SYSLOA.SRCJCONMAN.MAR; 1 - (day 
00 60 A3 «(19”~—séE2 1 1139 38: BBSS #CSBSV_STATUS_RCVD, = ; Add status received fla 
7 11% ESR STATUS(RS) .4$ . 
19 60 AS 01 £0 76 1141 4$: BBS #CSBS0_MEMBER, - : Branch if remote node is a member 
7B 114 CSB L TATUS(R3) ,5$ 3; _ of the local cluster 
52 a3 14 A2~ B80 7B 114 MOVW CLAS S$W_NQUORUM(RZ), = ; Remote node's quorum 
1144 CSBSW_QUORUM(R3) 
50 A3 «16 A2~—sBO 1192 MOVW CLAS TSOM VOTES (RZ). - ; Remote node's votes 
6— AS 12 A2~ 80 1107 MOVW CimsT Seu WOE 3 {Re}. -  ; Number of nodes in ~emote 
A 1168 CSB$W_NODES (R35) 3 _ node's cluster 
56 A3 «6-18 A2~ BO 4 Me MOVW CLAS TSS GbYOTES(R2) - ; Proposed votes for quorum disk 
54 AS 1A A2~ B80 4 1131 MOVW CLAS TSS L ERD LANT (RZ). - ; Lock manager directory system weight 
50 68 A4 2C A2 C3 94 1188 5$: SUBL3 CLASTSSL MAX_XTN(R2), = ; Update largest transaction seen 
9A 1154 CLUBSL_RAX_XTN(R4) .RO 
05 18 9A 1155 BGEQ 10$ 3; No update needed 
68 AS 2C A200 1: 1128 MOVL SLRS TSS, AR NTN iRe) - ; Update local information 
50 0088 C4 9A O3A1 1158 108: MOVZBL SLUSST_GOWAME (RG) .AO : Is local name defined? 
1D 23613 A6 1159 BEGL $ 3; If equal, then can't be the same 
30 A2 39 94 ABS 1160 CMPB 8 CLMSTSSB_QDISK(R2) ; Compare to received name Length 
17, 12 O3AC 1161 BNEQ 208 : Branch if different 
of 8 = 1196 PUSHR #*M<R2,R3> : Save registers 
31 A2 0089 C4 116 CMPC3 RO, CLUBST QDNAME+1(R4), = ; Quorum disk names match? 
7 1164 sae iy Gd 1SK+1(R2) 
0c «BA 7 1165 POPR #*M<R2,R3> ; Restore registers 
OA is 9 1198 BNEQ 20 ; Branch if disk names differ 
05 60 AS 0 «603:—CtiéEE 116 BBSS #CSBSV_QF_ SAME, - 3; Remember that disk names match 
1168 CSBSL_STATUS(RS),.20$ |: and branch if already known to match 
00 60 AS «(1A «C2 116 BBSS #CSBSU_SEND_STATUS, - ; Just set same bit, send status so 
0 1109 208 CSBSL_STATUS(R3) , 208 3 remote node has same opportunity 
05 60 AS =6(01~—Sts«éE 2 1126 BBS #CSBSV_MEMBER, - ; Branch if remote node is a 
A 117 SBSL STATUS (R3) , 30$ : member of the local cluster 
74 a3 40 A2 7D 1174 MOVa CLMSTS$Q REET IBGSRe) - ; Store reference time 
1175 SB$Q_REFTIME(R ) 
1126 
1177 ; 
1128 
117 
1180 
1183 
1183 
1184 
1185 
11 
11 
11 
11 
11 
11 
11 
11 
11 
11 
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ter Configuration Manager 16-SEP-1984 00:26: AX/VMS Macro V04-00 
VD. STATUS >= Status Received from a ~$FE= 1382 3:69:38 SYSLOA.SRCJCONMAN.MAR; 1 
ES 1196 ; 
Hf: 11 ; If remote node is a member of another cluster, bugcheck one of the 
; 1} 3 ; clusters. It is illegal for two clusters ever to see each other. 
e3 : BBC #CSBSV_CLUSTER, - ; Branch if remote node is not a 
e8 1 ? yee aTiie R$), 300$ 3; member of another cluster 
&8 1 : CMPL © CLUBSG_FTIME+4(R4), - : Compare high order foundation times 
ED 1 CLRSTSSQ_FTIME+4(R2) 
ED 1204 BGTRU +4 ; We are younger, so we die 
EF 1205 BLSSU 1208 ; Other is younger and should die 
Fi 1 § CMPL CLUBSQ_FTIME(R4), = ; Compare low order foundation times 
F6 1 FLMSTSSQ_F TIME (Re) 
F6 1 3 BGTRU 8 ; We are younger, so we die 
Fe 1 BLSSU 1208 ; Other is younger and should die 
FA 1210 CMPL CLUBSQ_LST_TIME+4(R4), =; Compare high order transition times 
FF 1211 CLMSTSSG_LST_TIME+4(R2) 
3 \§ BGTRU 0$ ; We are younger, so we die 
rt 121 BLSSU 120$ ; Other is younger and should die 
4 1214 CMPL CLUBSQ_LST_TIME(R4), - ; Compare low order transition times 
408 1215 CLASTSSQ_LST_TIME(R2) 
408 1 1 BGTRU $4 ; We are younger, so we die 
40A 121 BLSSU 1208 3; Other is younger and should die 
40C 1218 PUSHR #*M<R2,R3> 3; Save registers 
£05 1219 MOVL CLUBSL_LOCAL_CSB(R4),R2 ; Local CSB address 
412 1220 MOVL CSBSL_ Bags ong ; SB for local system 
0416 1221 MOVL CSBSL_SB(R35),R ; SB for remote system 
041A 1 § CMPC3 #SBSS"SYSTEMID, - ; Compare system ID's 
0420 1 SBSB_SVSTEMID(R2) , - 
4 1224 SBS$B_SYSTEMID(R3) 
4 1225 POPR #*n<R2,R3> 3; Restore registers 
4 1226 BLSSU 120$ : Other should die 
3 r ! 7 110$: 
B 2 ! : ; Should put code in RO to explain the bugcheck 
8 4 1231 BSBW + ts crac :; Bring down local cluster 
3; Exit 
r g } BRS 00$ Exi 
429 1234 ; Set here if we believe that the other cluster should die. 
: 2 ! 5 ; Send it status which may help it to realize this. 
be 9 1 $ 120$:  BBSS #CSBSV_SEND_STATUS, - ; Request that status de sent 
4cE 1 : CSBSL_STATUS(RS) 1308 
? ! i 130$:  B6RB 00$ : Branch to common exit 
ri 1 4} ; Get here if local node is not part of a cluster 
1 43 200$:  CMPB CLUBSB_CUR CODE(R4), - ; Is this node forming a cluster? 
434 1244 #CLMCNRSK_RTN_FORM 
434 1245 BNEQ 3; Branch if not 
436 1 rf BBC #CLMASTSSV_CLUSTER, - ; Branch if remote node is not 
124 CLMSTS$B_FLAGS(R25,210$ : a cluster member 
1 rt: BBSS ect Uesy ONLOCK, = ; Request failure/unlock to 
40 124 cue L_FLAGS(R4),210$ ; abort cluster formation 
: ; Branch to common ex 
o ! 210$ BRB & ht t 
42 1252; 
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; Common exit after receiving a status message. 
Deallocate message buffer, prepare to scan for work to do, and return 


3 3 
2 i 
$ $00$: POPR #*M<R2 ; Restore registers 
BSBW est Tite MSG_BUF _CSB + Deallocate message buffer 
28 bse6 START_TIMEOUT™ ¢ Look for something to do 
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SYSLOA.SRCJCONMAN.MAR; 1 
-SBTTL CNXSRCVD_TRNSTS = Received Transition Status Request Message 


FUNCTIONAL DESCRIPTION: 


This routine is called when a transition status request message 

is received. A reply is sent ede ag whether or not ™ specified 
transition in in or prior to Phase 0, in or post to Phase 2, or in Phase 
1 while this node does/doesn't have a connection to the coordinator. 

The purpose of this message is to allow a node caught in Phase 1 when 
its connection to the coordinator breaks to figure out what to do. 


CALLING SEQUENCE: 


JSB CNXS$RCVD_TRNSTS 
IPL is IPL$_SCS 


INPUT PARAMETERS: 


Re: Message address 
R3: CSB of sending system 
R4: PDT address 

R5 CORP address (uninitialized) 


OUTPUT PARAMETERS: 


NONE 


COMPLETION CODES: 


SIDE EFFECTS: 


CNXSRCVD_TRNSTS:: 
PUSHL 


RO-R5 may be destroyed. 


Save address of message 

Initialize the CORP for the response 

Restore address of message 

Address of CLUB 

Compare transition ID in message with 
last cqnpleted transition 

Branch if inconsistent 

Branch if same and return Phase 2 


BSBW  CNXSINIT_CDRP 

POPR #*M<R2> 

MOVL.  CSBSL_CLUB(R3).R4 

SUBL3 CLMCNRSL_XTN_IB(R2), - 
SLUBSL_LST_XTN(RG) ,RO 

BGTR $ 


BEQL 208 


; Here if ID in message is greater than last completed ID 


rx 


DYED MMIII & & sss , 


St I —§' AQOOTOKOOOOCOSOVOONOO0NO 


NAME WIN OOD NAUE WN O OCONO 
. 
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SUBL3 CLMCNXSL_XTN_ID(R2), = ; Compare transition ID in message with 
CLUBSL_COR_XTN(R4),RO : current transition 

BLSS 90$ 3; Branch if inconsistent 

BGTR 10$ ; Branch if same and return Phase 0 


; Here if ID in message matches current/last unsuccessful ID 


CONMAN - Cluster Configuration Manage 16-SEP-1984 00:26: AX/VMS Macro V04-00 Page 29 
¥04-000 CNXSRCVD. TRNSTS@~ Received t0er st 'S7$EE°]382 eon SYSLOA.SRCICONMAN. MAR; 1 oe 9, 
50 8F SO AG 91 $9 } ] CMPB Paetint tar Cs aaa ; Is phase UNLOCK? 
16 613 ‘ 1 BEQL 1 ; Branch if UNLOCK and return Phase 0 
40 BF S9 AG 91 ! CMPB a a ela - ; Is phase before or after Phase 1? 
OF 19 : 1 j BLSS 165 ™ 3; Branch if before paece 1 and return Phase 
11 14 4 } 2 BGTR 208 ; Branch if after phase 1 and return Phase 2 
5 } § ; Here if local system is in phase 1 of a transition 
51 5C AG 09 79 1 - MOVL CLUBSL_ COORD(R4) - Pl ; CSB of coordinator 
0c 60 Al 00 € 7D 1 BBS she tg gb ONG pace 3; Branch if broken and return Phase 1B 
1 CSBSL_STATUS(RI) , $0$ 
03 oD 133) PUSHL #CLACAXSK. RP_ TRNSTS. PH1 ; Return Phase 1 
14 #11 } § BRB ; Branch to common exit 
01 DD é 1334 108: PUSHL #CLMCNXSK_RP_TRNSTS_PHO ; Return Phase 0 
10 11 : | 5 BRB 40$ : Branch to common exit 
04 oD A 1 $ 20$:  PUSHL #CLMCNXSK_RP_TRNSTS_PH2 ; Return Phase 2 
a be : BRB 40$ ; Branch to common exit 
3 OD 1340 30$: PUSHL #CLMCNXSK_RP_TRNSTS_PH1B ; Return Phase 1 (coodinator connection bro 
CS 13 A2 E1 90 1341 BBC #CLMCNXSV-RP_TRNSTS_CMT, = ; Branch if commitment not requested 
95 1 $s CLMCNX$B_NEPLY(R2) 20S 
00 1C AS «614~—=CO@E2 95 134 BBSS #CLUBSV_BACKO :; Set backout inhibit flag in CLUB 
9A 1344 CLUBSL_FLAGS(R4S ,40$ 
0 OS 9A 9A 1345 408 MOVZBL #CLMCNRSK FNC DESC, : Foqstiey. specific function code 
0E69 30 90 1 6 BSBw SINIT STD : P for standard response 
36 AS 1 90 AO 134 MOVB DRPSC_VAC3+2(R5) 3; Store success in ACK field 
37 aS : F6 O4A4 1348 CVTLB taps : CD DRPSt PAT Se 3cRS) 3; Store reply data 
FB55° 31 re : $3 BRiw CAXSRESP. FORGET ; Send response message and forget it 
Oca 1351 90$: BUG_CHECK CNXMGRERR,FATAL ; Inconsistent state of message and this sys 
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voe~000 START_TIMEOUT T = Start random CLUB-based $73 =1982 88 69:35 SYSLOA.SRCJCONMAN.MAR; 1 = de 
4AF 1353 -SBTTL START_TIMEOUT = Start random CLUB-based timeout 
rns ! : «SBTTL START_LONG_TIMEOUT = Start long random CLUBsbased timeout 
4AF 1 § ++ 
4AF 1 3 
res } 8 3; FUNCTIONAL DESCRIPTION: 
4AF 1360 : If the CLUB fork blogk is free, start a timeou 
4AF 1361; An immediate return is made to the caller. chen the 
oe | 26 : timout occurs, the thread jumps to SCAN 
At ‘ : CALLING SEQUENCE: 
4AF 1 6 : JSB START_TIMEOQUT 
4AF 1367 ; JSB START_ LONG_TIMEOUT 
SAF 1 oe : 1Pe is IPLS_ sts 
4AF 1 : 3 
4AF 1370 ; INPUT PARAMETERS: 
ee 
4AF 1373: 
44F 1374 ; OUTPUT PARAMETERS: 
Beat i ie : NONE 
4AF 1377: 
O4AF 1 ; COMPLETION CODES: 
Sear 1380 NONE 
Dear 1381 : 
4AF 1 § 3; SIDE EFFECTS: 
4AF 1 é 
AF 1384; RO-R5 are destroyed 
tAE 4 é 
4AF 1 e 
4AF 1 START_LONG TIMEOUT: 
50 4620 8F 3C O4AF 1 3 MOUZWL #20000,R0 : 2000...19999 ms timeout 
0 11 434 30 BRB DO_ TIMEOUT 
B6 1392 START_TIMEOUT: 
50 1388 8F 3C rr 1398 ~  MOVZWL + #5000,R0 :; Range is 500..4999 milli-seconds 
5 re i ; sata tT 0 ; Save timeout range 
gah of BR | Ries, Stee tutssvarus ord Sates tgeeeaey 
50 =«BE : § C4 1 iat RS isp ; Update pieden number range 
53 fP3h i aeritt RDpL2 syAnoOn OB og ET my Meroe 
15 1C AS WD CE : 1? § S eth SL AFLAGS(RG) 368. : Branch if activity in progress 
55 gece fe x 3 1404 MOVAB BLOCK(R4),R5S ; Address of transition fork block 
0B 1C A & D8 1405 BBS ACLUBFRRSV F BUSY, = ; Branch if fork block in use 
DD 14 6 CLUBFKB cre BUST oe 
0084 o3 13 43 1° eet $L Brae CRG) ; TQE in use? 
01 1C A4 3 E 4E3 14 ; BBS #CLUBSV_INIT, - :; Branch if initialization complete 
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C N = Cluster Configuration Manager =SEP-1984 00:26: AX/VMS Macro V04-00 o 1 
voe~000 START LONG TIMEGUT © Start tong random C ScSEP=198¢ Oui09:29 FeySLOR.eAeICONGANeHAR:1 28° Fd) 
E8 141 CLUBSL_FLAGS(R4) ,40$ 
05 E8 1411 308: RSB a 
E9 141 
E> jelg so 
33 i 3; Do timeout, time in milli-seconds in R3 
51 30 3¢ O4€9 14617 508:  MOVZWL #TQESK_LENGTH,R1 : Size of timer queue entr 
00000000'GF 1 E 1913 JSB G“E XE SALONONPAGED ; Allocate one s . 
FB0B' 3 Fe 141 BSBW CNXSRESOURCE_ CHECK ; Watch out for totally exhausted resources 
3A E F514 Y BLBC . ; Can't allocate memory 
+4 A 1 8 F 14 MOVW R1, TQESW_SIZE(R2) * Store size 
AA F FC 14 : MOVB #DYNSC_TOE,TOESB_TYPE(R2) ; Store type 
14 A 4 0D 14 MOVL R4,TQESL_FR4(R2) ; Store time delay and CLUB address 
0084 £8 § i) 4 1426 MOVL R2,C C_TQE(R4) 3; Save TQE address in CLUB 
5 D be 1425 MOVL R : Poye address of TQE 
08 aS. 01s 90 14 $ MOVE  #TQESC_SSSNGL,TQESB_ROTYPE(R5) ; Store type of timer queue entry 
OC_AS  S7°AF 9E 10 14 MOVAB 8*80$ | L FBC(RS) ; Store address of timer fork process 
52 00 00002710 8F 53 7A 1 1428 EMUL R3,#102100 #0,R2 : Get milli-seconds and cvt to 100 ns. units 
50 00000900" GF 7D 1 1429 mOVG G°EXESGQ_SYSTIAE .RO : Get current time 
50 § Cc 1430 ADDL R2,R ; Add to current time 
51 § D 8 1431 AdwCc R35,R1 
00000000'GF 1 B 14 ; JSB G*EXESINSTIMG : Insert in timer queue 
0 1 ie ? RSB 3; Return 
FACB’ 30 1435 70$ BSBW CNXSCLUB_WAIT ; Wait a second or so in the CLUB 
Be 11 1 $ BRB 50$ 
7 14 3 3; Come here as a timer fork process to proceed 
7 1439 ; Inputs: 
7 1440; CLUB address 
g ved : R5 TQE address 
50 55 00 7 1228 80$: MOVL R5,R0 ; Address of timer queue entry 
00000000 ' GF 16 A 1444 JSB G*EXESDEANONPAGED ; Deallocate it 
0084 ¢4 55 O01 40 1445 CMPL R5 ,CLUBSL_TQE(R4) ; Is this timeout wanted? 
- a 4 1038 BNEQ : Branch if not and drop it 
0084 C4 «4 47 144 CLRL CLUBSL_TQE(R4) ; Clear pointer to T 
08 10 48 1033 BSBB ; Set up return address, look for work 
VAL XESAL | REPT,R ; Use non-repeating timer queue entry 
55 00000000 ' GF 3 rs 1085 90$ ar} G*EXESAL _TQENOREPT,R5 i i 
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v04-000 SCAN = Look "tor werk to do ’ g- SEF} 3b 8? ‘68: § UeYSLOA. SR SR SCONMAN. MAR: 1 - Ais 
1? § -SBTTL SCAN = Look for work to do | 
14 p++ 
14 Qi; : 
2 1? g : 3 FUNCTIONAL DESCRIPTION: 
1488 ; This routine is called whenever it might be appropriate to 
1459 ; look for somethin mg ce o. These instances include timeouts 
1399 : tries initialization and after receiving status from nodes. 
: 1488 ; CALLING SEQUENCE: 
: 2 1283 ; JSB SCAN 
22 1782 : IPL is IPL$_SCS 
: ie $ INPUT PARAMETERS: 
555 1469 : NONE 
55 1470 3 
055 1471 ; OUTPUT PARAMETERS: 
O38s j008 | NONE 
gage 1474 : 
0555 1475 ; COMPLETION CODES: 
B18 Fs 
0555 1478 : 
555 1479 ; SIDE EFFECTS: 
3322 1480 ; 
0355 1? ; : RO-R5 may be destroyed. 
555° (1483 * 
FDID 30 0555 1484 SCAN: BSBW CNX$ $SEND. ALL_STATUS 3 gene status as needed 
70 50 «6—€9)«=—0558 = 1485 BLBC RO,16 : Exit if couldn't send s 
6—E 1C AS = =6135——~—=C*#E:* 558 1288 BBC #CLUBSV_INIT, - 3: Branch if SYSINIT initialisation inconptet | 
560 1487 CLUBSL_FLAGS(R4) ,170$ | 
69 10 A4 «61D ) «EO «0560 «(1488 BBS #CLUBSO_TRANSITION, - ; Branch if activity in progress 
565 1489 CLUBSL -FLAGS(R4),170$ _; and drop thread 
55 o0occ c& 9 565 1490 MOVAB CLUB$B~ Gay BLOCK(R4) RS ;: adarese of transition fork block 
5F 1¢ AS 600 =O 56A 1491 #CLUBFRBSV_FKB BUSY : Branch if fork block in use 
56F 149¢ CLUBFKBSL STATOS(RSS 1 
58 1C AS 00 €0 OS6F 149 BBS #CLUBSV_CCUSTER, - : Branch if this node is cluster member 
374 1494 CLUBSL VFLAGS (Ras , 2008 
2 1486 : Local node is not a member of a cluster. 
ae 133 : Investigate joining or forming a cluster. 
Fag" 30 574 1299 : BSBW CNXSINIT_CSBS ; Clear out locked, selected bits 
1 C 0577 1 9 CLRa R1 ; R1 is last CSB from a cluster node 
2f8 1 3; R2 is number of cluster nodes seen 
FA84" 38 79 «1 § BSBW CNXS AN. cSBS 3; Iterate over t known CSB‘s 
20 8 E 57Cc 1 BLBC ; Branch when don 
1A 60 a3 00 £0 O57F 1504 BBS cg Vet cna : Branch to shie 1¢ there hes been 
2 4 1505 cee Bs OS TaTustn 1308 ; _a long brea 
15 60 AS 19—=«s«#€E 4 1 § BBC £8 Vs tn3s. ; Branch if status not received 
589 1 ($B ‘ STATUSER , 1308 | 
07 60 AS) «=—(08-—S—« EO =—(0589 =—1508 BBS #CSBSU_CLUSTE : Branch if remote node is a cluster 
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“SEP=1984 00:26: AX/VMS Macro v04-00 Page 
v04-000 SCAN = Look for work to do g- ee 138 90:89:58 SYSLOA.SRCJCONMAN.MAR; 1 . dy, 
58E 1509 CSBSL_STATUS(R3), 1108 ; member 
0B 60 AS «11_—séE 1510 BBCS HeSB80 SELECTED - 3; Mark node selected | 
151 £36 L_STATUS(R35 ,130 
09 = =11 : \ BRB $ 3; Join common exit | 
$ Dd 1514 110$: INCL fs ; Count cluster member node 
D 1515 TSTL R : Seen a cluster node before? 
-% 3B : 1 BEQL 120$ 3; Branch if no | 
238 1318 : Could check that R3 and R1 represent CSB's from the same cluster 
-) ae | 59B 1 { : MOVL R3,R1 ; Update last seen cluster node | 
Be ia im : 
7) we ew 4 : 140$:  TSTL R1 3 Any cluster members seen? 
WwW ta 2, 13 : BNEQ 150$ 3; Branch if members seen | 
si 1 § : Consider whether it is feasible to try to form a cluster | 
23 1C Ad) «612)~«C«E0«(O5A3 1508 BBS #CLUBSV_NO_FORM, = ; Branch if cluster formation is 
DAB 1529 CLUBSL_FLAGS(R45 , 160$ 
53 10 A4 OD 5A8 1530 MOVL CLUB$L_LOCAL GRD CRS) AS 3; Local CSB address 
50 AS. iB SAC 1531 TSTW CSBSW_VOTES(R3) : If local node has no votes, don't 
4 B2at 15 § BEQL 160$ 3; _ try to form cluster 
FA4C' 30 0581 15 BSBW CNXSQUORUM_CALC ; Compute votes, quorum, nodes 
51 50 D1 0584 1534 CMPL RO,R1 : Is there any possibility of a quorum? 
i¢ 1f Q5B7 1535 BLSSU 166$ 3; No quorum possible, go to common exit 
0oc8 c4) («OO D3 0589 1536 BITL #*Bil, - ; Has a foreign cluster heen seen recently? 
O5BE 1537 CLUBSL_FOREIGN_CLUSTER(R4) 
0B 12 OSBE 1538 BNEQ 160$ ; Branch if yes and don't try to form a clus 
4D «11 3 1273 BRB FORM_CLUSTER 3; Try to form a cluster 
6E Al 38 B1 O5C2 1541 150$:  CMPW R2,CSBSW_NODES(R1) ; Do we perhaps see all members? 
03 «IF 3C6 1348 BLSSU-160$ ; Nothing to do right now | 
028Cc_.—Osé31 zee 1207 id JOIN_CLUSTER 3 Try to join a cluster 
FEE® 31 pace 1302 160$: BRW START_TIMEOUT ; Begin a timeout and then rescan 
05 see 1347 170$:  RSB ; Exit, dropping thread 
4 1348 : Here if a cluster member looking for something to do 
03 1C AS 17 ~«#€1 = « OSCF 1224 200$: BBC #CLUBSV_LOST_CNX, - ; Branch if no cluster connection is broken | 
abe 1 § CLUBSL_FLAGSTR4) ,220$8 
018D 31 204 1333 BRw RECONFIG_CLUSTER ; Need to do failover | 
55 ° 8 507 1836 220$: MCOML 4#0,R5 ; Accumulate shutdown bits 
FA23" 5DA 1 2$ BSBW CNXSSCAN_CSBS ; Iterate over all known CSB's 
0d 50 ~=C€E 2p 155 BLBC ; Branch when done 
0760 a3 01 €1 O5€0 155 BBC #CSBSV_MEMBER, - : Branch if not a cluster member 
3 155 CSBSL_STATUS(R3), 3308 
50 60A3 02 E 156 MCOM ERO a Ls tATUSCR »,R 
55 50 A Q5E9 156 BICL RO,R ; Accumulate AND of all shutdown bits 
5 EL ! 8 2308: SB | 
0455 OA €E!1 ED 1 rf: 240$:  B8BC #CSBSV_SHUTDOWN,R5,250$ ; Branch if not ready to shutdown 
SF1 1565 BUG_CHECK OPERATOR,FATAL ; Cluster-wide shutdown | 
| 
| 
} 
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04-000 SCAN'= Look forswork to do” eh Pa EL CY RTS TOT Te a FD 
F5 1 
11 1C AG 1B £0 Fe 1 g 250$:  B8BS #CLUBSV_ADJ_QUORUM, = ; Branch if quorum adjustment requested 
FA 1 8 CLUBSL_FLAGS(R4) ,260$ 
1055 03 €1 OSFA 1 BBC MCSBSV-QF_SAME,R5,270$ ; Branch if not all members have same disk 
5501 99 EF i 1379 EXTZV #CSBSV_ QF"ACTIVE,#1, - ; Get AND of all member QF active bits 
’ 3 nto 
50 1C Ae OF 19 ED $5 1326 CMPZV #CLUBSV_QF_VOTE,#1, - ; Compare to present state of quorum disk 
609 157 yes. FLAGS(R4S ,RO 
03 13 0609 1574 BEQL $ ; Branch if present state is OK 
0508 31 : 13/2 ¢ 260$:  BRW ADJUST_QUORUM ; Attempt to adjust quorum/quorum disk 
7 : 1372 | ; Nothing to do right now, so drop thread 
05 060E 1359 3 270$:  RSB 
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CONMAN = Clus 
v04-000 FORM-¢ 


-SBTTL FORM_CLUSTER = Try to form a cluster 


++ 


¢ FUNCTIONAL DESCRIPTION: 


| 
i 
| 
| 
| 
j 


This routine tries to form a new cluster. It assumes that no 
cluster is known to this node. 


oe Di es De Ds Re Ds De es Ds i Bs i es i es te 


} | 
: 
HE 
1289 : 
HE 
6 1 30 > CALLING SEQUENCE: | 
: 1 8 : JSB FORM_CLUSTER 
: 9% HY IPL is IPL$_SCS 
GF 1595 : INPUT PARAMETERS: | 
Og 1397 : NONE | 
$60 1399 : OUTPUT PARAMETERS: | 
60F 1600 ; 
emis 
60F 1808 : COMPLETION CODES: 
O60F 1604 ; 
et 160¢ 3 NONE 
O60F 1807 ; SIDE EFFECTS: 
O60F 1609 ;: RO-R5 are destroyed 
O60F 1610 ; 
Sg 
060F 1818 FORM_CLUSTER: 
O58F 30 QO60F 1614 BSBW INIT_TRANSITION : Initialization for becoming coordinator 
50 AS «BS SC0612 «1615 TSTW CSBSO_VOTES(R3) : If local node has no votes, don't 
6A 13 0615 1616 BEQL 50$ 3: __try to form cluster 
58 AS) «6001 (90 s« 0617 «1617 MOVB #CLMCNXSK_XTN_FORM, - ; FORM transaction 
0618 1618 CLUB$B_CUR_ CODE (R45 
2C AS «650 ASOD Oee 1933 MOVQ See eimintse - ; Define foundation time of cluster 
00000018°GF 06 28 06 1621 MOVC3 M#CLUBSS_FSYSID, - ; Define founding system ID 
26 A4 627 16 : G*SCS$GA_LOCALSB+SBSB_SYSTEMID, - | 
629 16 CLUBSB_FSYSID(R4) | 
55 4 ° 9 1624 CLRL R 3; No CSB for message 
50 00060'CF 1625 MOVAB TRYFORM_MSG,RO 3; Trying to form cluster message | 
F9CD’ p 16 § BSBW CNXSCONFIG CHANGE 3; Make status known 
F9OCA’ 16 BSBW CNXSSCAN_CSBS 3 Examine all CSBs 
6 79 E § 16 BLBC R $ ; Branch when done 
1460 A3 19 €E1 0639 16 BBC #cSBSV STATUS_RCVD, = ; lgnore nodes that haven't sent 
63E 16 CSB : STATUS(R3),10$ : status 
OF 60 AS 1A €0 1631 BBS #CSBS0_SEND Status - 3 Ignore nodes that need status 
43 16 : CSB : STATUS(R3), 10$ 
0A 60 A3 00 €E0 16 BBS #CSB$V_LON rite - : Ignore nodes with whom the connection | 
48 1634 CSBSL_STATUS(R3),10$ ; is broken 
50 a3 3 7 19 5 a, $W_VOTES(R3) 3; Ignore nodes with no votes 
4 
00 60 A3 fi E 64D 16 $ BBCS #CSBSV_SELECTED, - ; Mark node selected | 
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v04-000 FORM_CLUSTE Ean! iry to form a cluster "er8 198 8 69; 8 SYSLOA. SR CICONMAN.MAR; 1 — db 
16 CSBSL mpc 
3 D £38 1 § 10$: PUSH Ae ; Save context regist 
oosc c3._ 20 00 «ESO : ia MOVES #0, (SP).40, S lore neces. | 
é cc 46 C3888 SRODERAP (AS) 
08 BA C 164 POPR <R3> 
05 O65€ 1644 RSB 
65F 1932 
gar jeep oo 
65F 1648 : Selected nodes are the possible population from which to form a 
tH 190 ; cluster. 
ads ¥ 30 065F 1651 ° BSBW CNXSQUORUM_CALC ; Compute votes, quorum, nodes 
ee D1 066 1636 CMPL RO,R1 : Is there any possibility of a quorum? 
1A sO1F 308 165 BLSSU 50 ; No quorum possible 
OACD 30 ret 1028 : BSBW LOC’ NODES 3; Attempt to lock selected nodes 
66A 1696 : Have locked all possible nodes 
so ¢ \o2t ; Assign temporary CSID's to 0+ 
Aig ae se a Bree RO eos Toes ALL don 
0B 60 A311 = €E1 670 1661 BBC #c$B$V_SELECT ; Grench 1f not selected 
67 166¢ CSBSL STATUS(RBS 40s 
F988" 30 0675 166 BSBW CNXSASSIGN_CSID 3 Create a CSID for the selected node 
05 50 ee 0678 1664 BLBS RO,40$ ; Branch on success 
00 1C AS «611 «2S: «=—(067B «(1665 BBCS #CLUBSV_UNL ; Request that everything be unlocked 
9680 1666 CLUBSL VFLAGSIRA) , 40$ 
05 Og : 1900 40S: RSB ; Resume scan | 
oBc2 31 ° ! 199) 50$: BRW UNLOCK _ALL ; Bail out of transaction | 
OBAD 30 8s $ 1873 & 60$: BSBW CNXSCHECK_UNLOCK ; Check for unlock request 
beay 1878 Prepare to describe all candidate nodes to all other candidate nodes | 
ea 1675 fORM_DESCRIBE: 
SA AG 4 0687 1926 CLRW CLUBSW_MSCCNT(R4) ; Count of responses to wait for 
F973° 4] ona 167 BSBW cas IN N_CSBS 3; Scan all CSBs | 
76 50 =€6—E9)=— 0680 1978 BLBC 5 Sranch if scan done | 
3160 A311 690 1679 BBC acéasves arise iso ; Branch if not selected | 
51 10 Ad ? 16 1 VL CLU taal OCAL pial to R1 ; Local CSB address 
0 4C Ad 1 ; MOVZWL C 3 wt att IBx 3; Subject node CSID index 
00. 008C c1 50 iH 19 BSS CSB$8_NODE (Rt) ),5$ ; Mark local node able to see node 
1€ 60 AS 6000~—Cé€EE 1684 5$: BBS acseset LONG Brea s arenes Li pornaneen break in 
1685 STATUSCR ),408 : — conn | 
1960 AS 18 €0 AB 16 $ BBS gees AL 3 Branch. Fi local csB 
D 16 CSBSL STATUS{AS) 108 
F950" D 1 3 BSBW ae SACLOC_CORP : Get a fork block 
F94D° 9 16 BSBW CNXSR SOUREE RCRECK : Watch out for exhausted resources 
11 29 E 16 BLBC RQ. 3; No memory available 
48 AS 0 6 169 MOVL *CDRPSL_VAL8(R5) 3; Address of node to talk to 
44 AS 64 E A 169 MOVAQ Crosse CeBUrt (Re), - 3; Address of CSB Listhead 
et) 169 CORPSL_VAL7(R5) 
5A AG B6 E 1694 INCW CLUBSW_MSGCNT (R4) : 
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-19 
TE ry to form a cluster “19 


ce 


BSB ; Describe nodes 


B 40$ 
BRw CNXSSCAN_CSBS_FORK ; Fork and continue scan 
10$: RSB 
208: BRW CNXSSCAN_CSBS_RETRY ; Wait and resume scan 


| 


: Tell a node about all of the others 


r 
| 
C1 1695 
tS ig § 
| | 
aa | 
ER 170 | 
Ae | 
CA 1704 
52 44 83 CA 1705 hos: MOVL @CDRPSL_VAL7(R5) ,R2 ; Next CSB to describe | 
44 a5 52 ¢ 12 : MOVL RZ, CDRPSL_VAL7(R5) : and save it 
D 1 ASSUME CLUBSL_CSBQFL EQ 0 
54 52 01 D2 1708 CMPL R2,R4 3; At end of List? 
y eS DS 1709 BEQL 1258 : Branch if done 
EE 60 A2 11 €1 D7 1710 BBC #CSBSV_SELECTED, - 3; Branch if not selected 
DC 1711 CSBSL_STATUS(R2) ,40$ 
9666 30 pc 17 § BSBW DESCRIBE “it 3; Tell one node about another 
54 644A dO DF 17 MOVL CSB$L_CLOB(R35) ,R4 ; Address of CLUB 
1250 €9 E3 1714 BLBC RO,120$ : Error sending message 
OA 51 £9 ES 1715 BLBC = R1,50$ : Branch if node is unknown 
A MOVZWL wd D_IDX R ; CSID Index of described system 
50 4C A2 0669 17 ZWL CS8$W_CSID_IDX(R2),RO dex of 1 
00 008€ c3_ —«50-—séE 6 i 7 f BSS RO, CSBSB_NGDEMAP(RS) , - ; Mark node visible 
D2 1C AS 11 E1 F 1719 50$: BBC #CLUBSV_UNLOCK, - : Branch if no unlock request 
cre V7 p CLUBSL_FLAGS(R4) ,40$ 
00 1C A4 11 E2 O6F 17 § 120s: BBSS #CLUBSV_UNLOCK, - ; Request that all be unlocked | 
O6FD 17 CLUBSL_FLAGS(R4) ,125$ 
ss» bere 1724 125$:  MOVL ; Address of CDRP 
J NON : Deallocate 
00000000'GF 16 9700 7 SB G*EXESDEANONPAGED Deall CDRP 
0706 1727 ; 
re 1798 3 terminate threads -- except for the last one 
SA AG B7 0706 17 9 130$: DECW CLUBSW_MSGCNT(R4) 
01 19 4 17 BLSS 140$ 3; Branch when done 
05 f : Vy § RSB 3; Terminate thread 
0825 30 o70¢ Vy 3 140$: BSBW CNXSCHECK_UNLOCK ; Check unlock request | 
70F 1736; 
7 F 17 $ ; Get here when all nodes have been described to all others | 
70F 17 § ; Now have told every node about every other node and each node's 
f : 1773 3; CSB contains a sap of nodes that can be seen 
70F 1741 FORM_PROPOSE: | 
pee ’ 30 70F 1766 ASB CHXSORT INIT ; Compute optimal cluster containing local n 
23 3 712 «174 BLBC ouse 0$ 3; Can't per iors computation (no pool?) 
coe . 3 71 1744 BSBW CNX S6aN_CSBS 3; Scan all CSBs 
15 € 718 1745 BLBC RO, 260$ ; Branch when scan is done 
OF 60 AS 11 «#€E1 071 1768 BBC #cSesv seLecree = ; Branch if CSB not selected | 
720 174 CSBSL_STATUS(R3) ,250$ 
50 4 43 45 7 1003 MOVZWL CSBSU_CSID_IDK(RS) ,RO : CSID index of CSB 
05 OOEC C4) 5 E 724 174 BS RO, = ; Branch if node is in desired cluster | 
72A 1739 CLUB$B_NODEMAP(R4) ,250$ ; 
00 60 AS 611 «©E€5 «(O72A=«CO175 BBCC #CSBSV_SELECTED, - 3; Clear select bit | 
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§ CSBSL_STATUS(R3) ,250$ 
250$: RSB 3; Advance to next iteration 


: Check for quorum 


2608:  B8SBW CNXSQUORUM_CALC ; Compute quorum, votes, nodes 
CMPL 0,R1 ; Is there A possibility of a quorum? 
BGEQU§ 2905 ; Have a quo 
270$: BRW UNLOCK_ALL ; Bail out of  trensttion 
290$: BSBW ROer08 ADJ 3; Create directory system vector 
BLBC ; Branch on failure 
upg N _NEWTIME (RE) 
MOVaQ CLUB$Q_NEW HAE(RG), 3; Save as reference time alsc 


CLUBSQ_NEWT IME “REF (R4) 
; Propose cluster <= Send Phase 1 Messages 


MOVZBL tar’ tats, FNC_FORM, - ; Facility specific message code 


CTROCRE) 
MOVAB UFBLD “PSR MSG 3; Address of routine to build 
asc CIxTCRGS ; status message 
BSBW SEND P PAI ; Send phase 1 messages 


| 
| 
| 
| 
| 
MOVQ Ree ees ovee IME 3; Save current time as new 


; ALL nodes have seen Phase 1 and ACKed it. 
3 Now is the time to send Phase 2. 


. BRW -«SEND_PH2 


: At the completion of sending Phase 2 messages, this location 

; is executed as a thread. 

FORM_FINISH: 
BRW FORM_JOIN_FINISH ; Branch to common form/join phase « process 


"yw 
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~SBTTL RECONFIG_CLUSTER = Reconfigure a cluster following a node failure 


+ 
+ 


| 
FUNCTIONAL DESCRIPTION: | 
This routine tries to reconfigure a cluster following a connection failure. 
This implements a fast and simple scheme that works only if a failure involv) 
all connections to a failed set of nodes. A second scheme is necessary to 
deal with the more complicated case of random connection failures. 
CALLING SEQUENCE: 


JSB RECONF IG_CLUSTER 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
NONE 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO-R5 are destroyed 


RECONFIG_ CLUSTER: 
SBW 


6sB INIT_TRANSITION Initialization for becoming coordinator 


MOVB #CLMCNXSK_XTN_RECONFIG, ; RECONFIGure transaction. 
CLUB$B_CUR_COBE (R4) 

CLRL R ; No CSB address 

MOVAB RECONFIG_MSG,RO : Initiating cluster reconfiguration message 

BSBW CNXSCONFIG_ CHANGE ; Make this state known 

BSBW CHKSSCAN_CSBS 

BLBC % ; Branch when done 

BBC #CSBSV_MEMBER, - : Ignore nodes that are not members of 
CSBSL_STATUS(R3) ,10$ ; _ the local cluster 

BBS #CSBST_LONG page - : Ignore nodes with whom the connection 
CSBSL_STATUS(R3),10$ : is irrevocably broken 

BBCS #CSBS? SELECTED - ; Mark node selected 
CSBSL_STATUS(R35,10$ 


10$: RSB 
308: 


: eycortnd nodes are those proposed for the members of the reconfigured 
; cluster. 


BSBW LOCK_NODES ; Attempt to lock selected nodes 
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CONMAN ster Configuration Man 16-SEP-1984 00:26: AX/VMS Macro V04-00 
vou000 Fig CLUSTER - Reconfigure. a cluster iets 1 80:59:38 SYSLOA.SRCJCONMAN.MAR; 1 
| 
78E 184 
f E ! oF RECONFIG_LOCKED: | 
, ! a3 Now, exchange topology messages with all member nodes 
SA AG Pee 185 CLAY  CLUBSW SGCNT(R4) ; Initialize waiting count 
59 A430 7 1 MOVB ecLAacn NXSK_DATA ; Mark this as Phase 
795 1 3 CLUBSB CUR PHASE (R4) 
F868" 795 185% BSBwW CRXS CAN_CSBS 3 Iterate over all CSBs 
44 E 798 1855 BLBC 3; Branch when done 
18 60 A311 «=€E1 «0798 1 36 BBC #cSBsv SELECT ED ; Branch if not selected 
7A0 1 2 STATUS (R35 , 408 
16 60 AS 18 £0 Q7A0 1 8 BBS Pats LOCAL : Branch if local CSB 
7A5 185 CSBSL STATUS{R3) 40$ 
11 60 A3. =: 00 7A5 1860 BBS #csesv_e :; Branch if connection is 
O7AA 1861 CSBSL STATOSERE) Los permanently broken 
F853° 39 7AA 1 6¢ BSBw CNXSACLO oc YARMCDAP. CSB | 
£38" 0 O7AD 186 BSBW NXSRESOURCE_CHECK™ 3; Watch out for sfunpusted resources 
09 5 £9 rey 1308 BLBC 3; No qenery available 
5A AS B6 07B3 1865 INCW C UBSW_MSGCNT(R4) 3; Include in wait count 
07. +10 7B6 1 96 BSBB ; Describe nodes 
F845" 31 ree ! rt BRW CNXSSCAN_CSBS_FORK ; Fork and continue scan 
05 ree 136) 40$: RSB ; Return and continue scan 
F841" 31 OpBE 1871 50$: BRW CNXSSCAN_CSBS_RETRY ; Delay and resume scan | 
Heal 
ooer ! n : Send topology message to one node | 
50 OF 9A gree 1 6 é0s: MOVZBL #CLMCNXSK_FNC_TOPOLOGY,RO ; coe remy code 
0B4D 30 ce 187 BSBW NIT STD_ASG ~ ; Standard CDRP message initialization 
4C AS 1022'°CF 9E O7C 187 MOVAB unBLB TOPOLOGY_MSG, 3; Address of routine to build 
7CB «187 CORPSC_MSGBLD(RS5) 3 topology message 
F832° 30 me ! , BSBW ERXSSERD _¥S6_CS6 ; Send message 
7cE 1 : We are resumed here when the response message arrives. | 
7cE 1 ; Registers contain 
7CE 1 ; R Status 
a Be : R2: Address of message buffer 
7CE 1 $ R3: Address of CSB 
7CE 1 3 R4: Address of PDT 
re ! : RS: Address of CDRP 
08 50 59 OrcE 3 : BLBC «RO, 80$ ; Branch on no data received 
D 28 O70% 1 PUSHR #*M<RO,R2,R3,R4,R5> ; Save regist 
008c ¢3 «414 A2 20 28 Y/d3d 1 MOVC3 #CSBS$S_NO 3 Fill in sommectietia in sending node's 
ZDA CLATOPSB NOD NODEMAB (R2) ; 6¢SB | 
3D 7 7DA 1 POPR #°n<RO,R aie Re 35> ; Restore registers 
0807 30 Zoe 3 80$:  BSBW CNRSPROCESS “RESPONSE =; Deallocate storage | 
pF 38 ; terminate threads -- except for the Last one | 
SAAS 87 ODE I Sos:  DECw CLUBSU_MSGCNT(R4) | 
01 9 O7E2 1 BLSS $ ; Branch when done 
05 O7E4 1 RSB : Terminate thread | 
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04-000 RECONFIG CLUSTER = Reconfigure a cluster S-sep-19b6 SusO9i29 LeveL OA. ReStoNGANC ARs: Pade A190, 
7E5 1903 
OASC 8 30 43 } : 100$: BSBW CNXSCHECK_UNLOCK ; Handle a pending unlock request | 
43 ! $ RECONF 1G_PROPOSE: 
7E8 19 3 : Get here when all nodes in the proposed new cluster have been locked. | 
rE 13 ; Compute and send Phase 1 proposal messages. 
F815* 30 O7E8 1911 ° BSBW © CNXSOPT_INIT ; Compute optimal subclust | 
21 50 3 7E8 i BLBC RO, 3 Can't senoute ine poolt) 
cages 30 O7EE 191 BSBU CNISSCAN_csBS ? Scan all CSB's 
15 50 E9 O7F 1313 BLBC =—_—«RO., 20 ; Branch when done 
OF 60 AS 11 =E1 O7F4 1915 BBC #cSBSV sey ecres - ; Branch if not selected 
7E9 1916 CSBSL_ STATUS (R35, 10$ | 
50 4CA3 3C¢ 7F9 «191 MOVZWL CSBSW-CSID_IDX(R3) ,RO ; CSID index of CSB 
05 OOEC C4 50 €0 O7FD 1918 BBS RO, - ; Node is in computed subcluster | 
0803 1919 CLUBSB_NODEMAP(R4),10$_ ; 
00 60 AS 11 #24+E5 0803 1920 BBCC #CSBSV Petr ciee - ; De~select node not in computed cluster 
0808 1921 CSBSL_STATUS(R3) ,10$ 
05 0808 19 § 10$: RSB ; Return and resume scan 
B85 158 aos 
F7F4* 30 0809 1925  §  BSBW  CNX$DIRVEC_ADJ ; Adjust size of lock manager direct ' 
03 50 8 O80C 19 § BLBS 5 p 3 ons on success “tpn eaten. Biss 
0A34 1 peut i 8 25$: BRW UNLOCK_ALL 
F7EB’ 30 O82 Db ; 30S: BSBW CNXSQUORUM_ CALC ; Calculate and store quorum related paramet 
pete 1383 : Propose cluster -=- Send Phase 1 Messages 
70 AG) «= (08Bs*FGA Bai3 1938 y MOVZBL SCL Aree PC ne COM 16. - ; Message code 
78 AG = OBFA'CF —9E Oaie 1332 MOVAB W*BLD_RECONFIG_MSG, - ; Address of routine to build 
sie 19 § CLUBSC_CTX1(R4) 3 status message 
083D 630 pete 1938 BSBW SEND_PA1 ; Send phase 1 messages 
08 1939 : ALL nodes have seen Phase 1 and ACKed it. 
83 Po 3 Now is the time to send Phase 2. 
0899 31 08 1948 : BRW SEND_PH2 
5 1944 ; At the completion of sending Phase 2 messages, this location 
8 1322 :; is executed as a thread. 
1949 RECONFIG_FINISH: | 
F7D8" 30 1948 BSBW 3s CNXSSCAN_CSBS ; Iterate over all CSBs 
1850 = E9 1949 BLBC ; Branch when scan is done 
12 60 AS =611~—~—=C*#€* 19 9 BBC #cSBsv SEL eC TER - ; Branch *f node not selected 
19 cSBSt STATUS(R3) ,208 | 
50 =F 0 19 § MOV #CSBS$S_NODEMAP-1,R ; Byte count of nodemap 
5 O9e¢ C44 1953 10$ MCOMB  CLUBSB-NODEMAP(R4)(ROJ,R2 
8c C 5 8A 1954 BICB Rp. CSBSB_NODERAP(R ) rb) ; CSB = CSB & CLUB 
F1 5 F4 F 132? SOBGEQ RO,10$ 
05 ‘§ 1? § 208: $B 
081D 30 rhe 1988 308: BSBW = =&UPDATE_QUORUM ; Update quorum, votes, nodes 
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v04-000 RECONF IG CLUSTER - Reconfigure a cluster wet 7 bo :89:09 SYSLOA.SRCJCONMAN.MAR; 1 ” Rist 
r 196 ; Handle bookkeeping for removed nodes. 
Brey 38 46 1 BSBW CAXSSCAN_CSBS 3; Iterate over all CSBs 
1350 € 49 1 BLBC RO,60$ ; Branch when done 
0A 60 A3 11——s«EO 46 1964 BBS #cSBsv SELECTED - ; Branch if CSB selected - 
3 1965 CSBSL_STATUS(R35,40$ : still a cluster member 
08 49 AS =«2(01-SCtié#@€’ +71 om 96 BBC ] 38 MEMBER, = ; Branch if not a cluster member 
196 CSB$L_STATUS(R3) , 50S 
0Bag 30 1298 BSBW BEROVE NODE ; Mark the node out of the cluster 
0 11 22 138 BRB 50$ ; Branch to common exit 
F7A2" HS 58 131 $0$: BSBW CNXSMARK_UNLOCKED ; Mark node unlocked 
5E 1 ie 50$: RS8 3; Continue scan 
af 197% 60s 
Ser 1975 ; 
TH 1378 ; Recompute value of CLUBSV_LOST_CNX 
00 1C A4 17 €5 O8SF 1978 ° BBCC #CLUBSV_LOST_CNX, = ; Clear bit prior to rec ting its 
0864 1999 CLUBSL.FLAGSTR4) .70$ - miss ioem, 
F799" 30 64 1980 70S: BSBW CNX$SCAN_CSBS ; Iterate over CSBs 
10 50 €9 Bae 1981 BLBC RO,220$ : Branch when scan is done 
0A 60 AS 01 =€1 O86A 19 § BBC #CSBSV_MEMBER, - : Branch if node is not a cluster member 
OB6F 19 CSB$L_STATUS(R3), 210$ 
05 60 AS «6000~—Ct—=é8€E* of 1984 BBC #CSB$V_LONG pace - ; Branch if no long break has happened 
08 4 1985 CSB$L_STATUS(R3) ,210$ 
00 1C AG «617—~—~—=CO*E2 74 1386 BBSS #CLUBSV_LOST_CNX, - 3; Mark cluster connection lost 
05 Tas at t4 2108 ame CLUBSL_FLAGSTR4) ,210$ 
87A 1989 
F783" 30 OB7A 1990 220$: BSBW CNXSDIRVEC_FILL ; Recompute lock manager directory vector 
OOAC C4 6 087D 1991 INCW CLUBSW_MEMSEQ(R4) 3; Advance membership state sequence number 
F77C* 30 0881 1338 BSBW CNXSMEMBERSHIP_CHANGE ; Begin table eresseesag to remove nodes 
O9BF 31 0884 199 BRW UNLOCK_ALL ; Make sure everything is unlocked 
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CONMAN - Cluster Co r 
voe~000 JOIN CLUSTER ry to join a cluster SEP=19 SYSLOA.SRCJCONMAN. 
q 199) -SBTTL JOIN_CLUSTER = Try to join a cluster 
18 oe 
f 339 : FUNCTIONAL DESCRIPTION: 
4 2 : This routine is gathee by a newly booted node that decides to 
4 § ; request membership in a cluster. 
2 4 ; CALLING SEQUENCE: 
7 ; JSB JOIN_ CLUSTER | 
i 09 3 IPL is IPL$_SCS | 
8 f 09 : INPUT PARAMETERS: 
0887 1 ; NONE 
0887 i > OUTPUT PARAMETERS: 
0887 14; 
tt 1? 3 NONE 
0887 O17 : COMPLETION CODES: 
se ap: 
0887 0 1 : SIDE EFFECTS: 
0887 20 § : RO-R5 are destroyed 
887 8 4; 
+H 5 3-- 
Bay 0 5 JOIN_CLUSTER: 
55 D4 rth 8 CLRL RS ; Will hold CSB address on return 
F774° 30 0889 2029 BSBW CNXSSCAN_CSBS 3; Examine all CSBs 
16 50 E9 O88C 2030 BLBC $ 3; Branch when done 
10 60 AS «619~—sé#E:? F 2031 BBC #CSBSV_STATUS_RCVD, = ; Ignore nodes that haven't sent 
94 20 : CSBSL_STATUS(R3),10$ : status 
0B 60 AS 08 €1 94 8 BBC #CSBST_CLUSTER, - : Ignore non-cluster members 
899 4 SBSL_STATUS(R$) ,10$ 
06 60 AS 00 €0 99 2035 BBS #CSBS0_LONG ie - ; Ignore nodes with whom the connection 
089 6 CSBSL_STATUS(R ),10$ : is broken 
55 53 0 Hj MOVL R3,R 
F75C* 31 | 8 BRW CNXSSCAN_CSBS_EXIT ; Return CSB address of cluster member 
05 4 re 10$: RSB 
ss. 8 A rk: 208: MOVL R5,R3 ; CSB address of node to apply to 
sc 1 4 BEQL 5 : No node to apply to at this time 
27 60 A3 A € 44 BBs #CSBSV_SHUTDOWN, - ; Branch if node in shutdown mode 
F 2045 cSBst STATUS(R35 ,50$ 
22 60 Ad =«Oo1A~—Cé*éO F r, BBS ocse 0_ SEND STATUS -  ; Branch if status not yet queued 
4 CSB$L_STATUS(R3) ,50$ : _ for transmission 
F749" 3 4 rt} BSBW CNXSALLOC_CDRP_ONLY ; Get a C 
1c 5 E 7 4 BLBC 3; No memory available 
5 64 A A 30 MOVL  CSB$L_CLUB(R3).R4 > CLUB address 
BAG 0 E MOVB #CLMCRXSK_XTN_JOIN, - ; Transition identifier 
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v04-000 JOIN N-CLU STER fry to join a cluster oro Ei 3ke ve 89; 8 YeYSLOA. SRE SCONMAN.MAR; 1 . (20) 
¢ CLUB$B_CUR_CODE(R4) 
50 02 A C 38 MOVZBL ACLRCNRSK acne ENTER,RO ; Poctitty s spe ecific message gode 
OASA 8 C : BSBW INIT ; Standard CDRP message initialization 
rae C 5 BSBW CNX XSSEND- Poecet ; Send message and forget it 
55 dO Bare 828 MOVL R3,R ; Address of CSB 
50 0000'CF 3 cE 5 MOVAB REQJOIN_MSG,RO : Requesting cluster membership 
F72A° 3 08D3 2058 BSBW  CNXSCONFIG_CHANGE ; Make this state known 
FBD6 1 08D6 059 50$: BRW START LONG. TIMEOUT 
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Received a Ptuster memb 5-SEP=- SYSLOA.SRCJCONMAN.MAR; 1 (21) 
-SBTTL CNXSRCVD_ENTER = Received a cluster membership request 
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FUNCTIONAL DESCRIPTION: 
This routine is called when a cluster membership request is received. 
if the request looks valid, the protocol for adding a node to a cluster 
S executed. 
CALLING SEQUENCE: 


JSB CNXSRCVD_ENTER 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
ih oa e eeareee 
R4: pot eddress 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 


RO-R5 are destroyed 


CNXSRCVD_ENTER:: 
F724° 30 BSBw 


NXSDEALL_MSG_BUF _CSB 
) | 5 meen. 
50 0000'CF 
F719" 


Deallocate the message buffer 
Address of CSB 
Address of message block 
Received cluster membership request 
Address of CLUB 
Check for: 

Transition in progress 

Node addition inhibited 

Shutdown in progress 


ao 
w 

> 

= 


EQ_MSG,RO 
BSB CNXSCORFIG_ CHANGE 
MOVL CSB$L_CLUBTR3) ,R4 
BITL a< - 

CLUBSM_TRANSITION ! - 
CLUBSM_LOST_CNX ! = 
CLUBSM-SHUTBOWN>, - 

SLUGSL FLAGS (RA) 


54 64 AS 
1C AS 20800004 BF D 


SPP MINN INIY & MWIWIWWWIWWWD SF&F OOOOOOOOOVOOCOOWOOVODOOOVOOVONOOODODOOWOOOOWOOONO I 


F 
F 
; 
30 =—12 F BNEQ : Branch to ignore request 
28 1C AS =6000-~St—é€’* F BBC #CLUBSV_CLUSTER, - ; Branch if this node is not a cluster 
é CLUBSL_FLAGS(R4S, 208 : member 
60 A3 04000007 8F 03 F BITL ac - 3; Cneck for: 
8 CSBSM_SEND_ STATUS ! - ; Requestor is out of date 
CSBSM_MEMBER ! - ; Requestor already a cluster member 
CSBSM_LONG BREAK ! - ; Connection problem to requestor *** why? 
CSB5R REROVED?. - ; Requestor removed from cluster 
BSL_STATUS(R3) 
8 BNEQ ; Branch to ignore request 


mn 
=n 


1 
1C 60 A3 19 BBC #CSBSV_STATUS_RCVD, - ; Branch if we don't have info on 


- Cluster Configuration Manager 16=SEP=1 0:26: AX/VMS Macro V04-00 Pa 4 CO? 
CNXSRCVD_ENT g Received a OPT aes memb §- -SEP-1 1984 90:89:38 SYSLOA.SRCJCONMAN.MAR; 1 ” (21) vOé 
CSBSL_STATUS(R3), 20$ the requestor 
70 a6 «553——s«é MOVL ggett CLOBSL_CTXO(R Rb) Save joining node CSB address 


The following piece of code assumes that CNXS$SCAN_CSBS returns CSBs in order of 
increasing system ID. 


te nf 
VD_ENTER = 
909 118 
909 211 
90D 2120 
90D 2121 
90D 21 § 
90D 21 
55 01 B8 90D 2124 MOVL #1,R5 ; Assume local node has lowest System ID 
OED" 319 125 BSBW RO,308 csBs 3; Iterate over all CSBs 
1050 €9 091 1 § BLBC RO, 308 ; Must have found something 
0A 60 a3 01 «E71 «0916s 21 BBC #c$as : Branch if CSB is not for a member 
91B 2128 CSBS$ Ve aTOsch3), 20$ 
02 60 AS 18 £0 09 129 BBS #CSBSV_LOCAL ; Branch if not local CSB 
9 130 CSBSL_ STATUS(R3), 10$ 
55 4 09 1 CLRL R ; Local node is not lowest system ID 
F6DB' 1 83 : 10$: BRW CNXSSCAN_CSBS_EXIT 
G5 03 ; } : 20$: RSB 
FC 55 —«E9 43 3 } $ 30$: BLBC R5,20$ :; If this is not the right node, drop thread 
4 4 138 ; Here, the transition to add the node begins 
58 AS 38600202 S90) s—(0929) = 2140 MOVB get ger XTN_JOIN, = ; JOIN transaction 
092D 2141 CLUB$B_CUR_COBE (R45 
0271 30 092D 146 BSBW INIT_TRANSITION : initigl {zation for _becoming coordinator 
55 70 AG DO 0930 214 OVL CLUBSL CTXOCRED . R5 3; CSB of joini ng ne 
50 0000'CF 43 0934 2144 MOVAB JOIN ; Initiating ad sehen of system to cluster 
F6C4' 30 0939 2145 BSBW CNXSEONE IG CHANGE : Make this state known 
F6C1" 30 093C 2146 BSBW CNX$SCAN_CSBS ; Iterate over all CSBs 
0B 50 «ED 2548 147 BLBC 0, 6 ; Branch when done 
05 60 A3-—sCéOO E1 B2$ 148 BBC #CSBSV_MEMBER ; Branch if not a cluster nember 
0947 2149 CSBSL STATUS(R3) 50$ 
00 60 AS 11 E2 0947 2150 BBSS #CSBS07_S TED ; Select member nodes 
094C 2151 CSBSL_ STATUS CR 5, 508 
05 bat 13 50$: RSB 
53. 70 A&4 DO 094D 2154 60S: MOVL LUBSL_CTXO(R4) ,R3 ; CSB address of joining node 
60 AS 00020000 8F C8 0951 2155 BISL2 #CSBSM SELECTED, - 3; Mark joining node selected 
959 136 CSB$L_STATUS(R3) 
F6A4" 30 0959 215 BSBW CNX$Q0ORUM_CALC ; Calculate quorum related parameters 
51 50 01 O95C 2158 CMPL 0,R1 3; Votes >= aera 
OA (1E O95 159 BGEQU 80$ : Branch if y 
20 AS =22 A4- «BI SoCé0961Ss 2160 CmoW CLUB$SW_VOTES(R4) 3; Is there eirrentts a@ quorum present? 
9966 161 UBSW “QUORUM(RAS — 
03 IF 096 1 ¢ BLSSU $ ; Branch if yes, don't undo quorum by adding 
08DB 31 368 163 70$:  BRW UNLOCK_ALL : Abort transition 
F692" 30 0968 2165 80$ BSBW CNXSASSIGN_CSID : Assign a CSID 
F7 5 E9 395 198 BLBC RO,70$ : Branch on failure 
07¢c3 «630 44} 168 BSBW LOCK_NODES ; Attempt to lock selected nodes 
45) 1%9 JOIN_LOCKED: 
54  00000000'GF DO 0974 76 MOVL G*CLUSGL_CLUB,R4 ; Address of CLUB 
SA AG BG 78 173 CLRW CLUBSW_MSGCNT(R4) : Count of responses to wait for 
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gre 1f? ; Describe all member nodes to joining system 
F67F' 38 ort 153 BSBW CNXSSCAN_CSBS ; Iterate over all CSBs 
20 50 =«CE 9 178 BLBC RO ; Branch when all eystens described 
2160 AS 11 #+€E1 0984 217 BBC #cSBSV ee rer Ee - ; Branch if node not selected 
989 2180 CSBSL_STATUS(R3S,10$ 
10 10 AG 611—S EO )=—0989) 2181 BBS #CLUBSV_UNLOCK, = ; Branch if unlock requested 
98E 21 ; CLUBSL_FLAGS(R4),15$ |: | and abandon this transition 
F66F 30 9 E 1 BSBW CNX$ALCOC_CDRP_ONLY 3; Get a fork block 
F66C’ 9 184 BSBW CHXSRE SOURCE _CRECK ; Watch out for exhausted resources 
17 E9 0994 2185 BLBC RO,20 3; No memory available 
DD 9997 21 § PUSHL R 3; Save scan context 
52 DO 0999 21 MOVL R3,R2 ; CSB of node to describe 
53 70 A4 010 099 198 MOVL CLUBSL_CTX0(R4) ,R3 ; Address of joining node CSB 
5A AG 68 9A 18 INCW CLUBSW-MSGCNT (R4) ; Increment waiting count 
ee 9A 190 BSBB 60$ : Provide immediate return address 
08 e 9A 191 POPR #*M<R3 ; Restore scanning context 
F656" 31 Beal 138 BRW CNXSSCAN_CSBS_FORK ; Fork and resume scan 
05 ns 132 10$ RSB 
: & i 3 Ex rom iteration 
F652" 31 hone 13 15$ BRW CNXSSCAN_CSBS_EXIT Exit f i ti 
F6O4F* 31 O9AE 2198 208: BRW CNXSSCAN_CSBS_RETRY ; Wait and resume scan 
0981 $200 
44:9) 201 ; Describe joining system to all member systems 
F64C*' 30 0961 88 S0s: BSBW CNXSSCAN_CSBS ; Scan all CSBs 
43 50 E9 09B4 04 BLBC ; Branch if scan done pe 
1F 60 AS 11.—=«E1 «0987 «2205 BBC #CSBSV_SELECTED, - : Branch if not selected 
99B¢ 06 CSB$L_STATUS(R3) ,40$ 
1A 60 AS 18 £0 OQ9BC 07 BBS #CSBSV_LOCAL, - 3; Branch if local CSB 
ogc 08 CSBSL_STATUS(R3) ,40$ 
15 60 AS 00 £0 Q9C1 209 BBS #CSBS$0_LONG cp - ; Branch if connection permanently 
09€6 2210 CSBSL_STATUS(R3),40$ =: broken 
637° 3 09C6 11 BSBW CNX$ACLOC_CDRP_ONLY 3; Get a fork block 
F634" 30 0909 1 BSBW CNXS$RESOURCE_CRECK ; Watch out for exhausted resources 
0D 50 €9 QO9CC 1 BLBC ° : No memory available 
52 70 AG DO O9CE 3914 MOVE — CLUBSL_CTXO(R4) ,R2 : Address of joining node CSB 
5A AG 58 903 15 INCW CLUBSW-MSGCNT (R4) ; Increment waiting count 
+4 1 BSBB 60$ 3; Describe nodes 
F625* 31 Bape : BRW CNX$SCAN_CSBS_FORK ; Fork and resume scan 
05 + 19 40$: RSB 
F621° 31 44 1 50$: BRW CNXS$SCAN_CSBS_RETRY 3; Wait and resume scan 
0569 30 O9DF : 60$: BSBW DESCRIBE_NOD ; Tell one node about another 
54 644A 4! 9E 4 MOVL CSBSL_CLOB(R3) ,R4 ; Address of 
03 50 € 9E 5 BLBC RO, 708 ; Error sending message 
05 51 e8 9E § BLBS R1,80$ ; Branch if node is known 
00 1C AS «611—~C‘éEE 9EC 70$: BBSS #CLUBSV_UNLOCK, - ; Request that all be unlocked 
FI 8 CLUBSL_FLAGS(R4) ,80$ 
50 55 DO Q9F1 80$: MOVL R5,R 
00000000'GF 16 a4 : JSB G*EXESDEANONPAGED 
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"BrSEp=1984 b4:69:09 rib 
; terminate threads -- except for the Last one 


1308:  DdECW FLUBSU_MSGCNT (RA) 
BLSS 40$ ; Branch when done 
RSB ; Terminate thread 

1408: BSBW CNXSCHECK_UNLOCK 3; Handle unlock request 

: Now give the new node the information it needs to fill in its 

; Cluster vector. The occupied slots will be taken care of in 

; the normal course of events. The available slots are given 

: the value 1 Bang last sequence number used in this sequence 


of instructions. 


MOVZWL G*CLUSGW_MAXINDEX,R3 ; Number of vector slots 
BRB 240$ 
s0gs: BSBW CNXSCLUB_WAIT ; Wait a second, saving only R3 
10$: MOVL te + tema ; Address of cluster vector 
TSTL (RI) CRS. ; Contents of first slot 
BLSS 40$ ; Found CSB == slot in use 
BSBW CNXS$CL 3; Release control 
BSBW CNXS$SCHECR_UNLOCK ; Bail out if unlock has been requested 
BSBW CNXSALLOC_CDRP_ONLY 3 Get a fork block 
BSBW CNXSRESOURCE_CRECK : Watch out for exhausted resources 
LBC RO,200$ ; Branch if CORP allocated 
PUSHL R ; Save scan context 
OVL CLUBSL_CTXO(R4) ,R3 3; Address of joining node CSB 
MOVZBL M#CLMCNRSK FNC_VEC,RO  ; Cluster vector description 
SBW INIT_STD_ASG ; Standard message initialization 
MOVAB W*BLO MSG, - ; Vector message building routine 
CORPSC_MSGBLD (RS) 
MOVL (SP) ,CBRPS$L_VAL8(R5) ; Store Cluster vector index 
BSBW CNXSSEND_FORGET ; Queue message and forget it 
POPR “A<R5> 3; Restore context for scanning 
240$: SOBGEQ R3,210$ : Iterate over all slots 
OVL  G*CLUSGL_CLUB,R4 : Address of CLUB 


3; Get here when all nodes have been described to all others 
3; Now have told every node about every other node and each node's 
; CSB contains a map of nodes that can be seen 
JOIN_PROPOSE : 

MOVCS (SP) ,# : Init mer of nodes that are 
CLUBSS_NODEMAP, - : y 


#0 0, - 
4 totally connected 
CLUBSB_NODEMAP(R4) 
BSBW CNXSSCAN_CSBS 3; Scan all CSB's 
BLBC RO,24 : Branch when done 
BBC #cSBSV ttt - ; Branch if not selected 
CSBSL_STATUS(R3) ,210$ 
MOVZWL CSBSWTCSID IDX(R3),RO  ; CSID index of CSB 
BBSS RO, CLOBSB_RODEMAP(R4) , - ; Node is part of proposed cluster 
210$: RSB ; Return and resume scan 
2408: ; 
BSBW CNXSDIRVEC_ADJ ; Adjust size of lock manager directory vect 
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vou-000 CNXSRCVD_ENTER : Received a Pluster memb ety 7 8:69:29 LSYSLOA. SRESCONMAN. MAR: 1 . (21) 
03 38 58 A7 8 BLBS RO,250$8 ; Branch on success 
07D 1 QA? y BRW UNLOCK_ALL ; Can't adjust vector size, abort 
“! 4 2508: 
Ms 38 ; Propose cluster -= Send Phase 1 Messages 
70 a4 «009)s«9A.—s«OOA? 95 * MOVZBL M#CLMCNXSK_FNC_JOIN, = ; Facility specific message code 
NTA 2296 CUBSL.CTRO(RS) ius . 
78 AG OBFA'CF 9E OQA7A 9 MOVAB W*BLD_JOIN_MSG, - ; Address of routine to build 
A8 38 CLUBSC FTXT(RAS ; status message 
O5pc =—s_-« 330 " + BSBW SEND_PA ; Send phase 1 messages 
A 84 ; ALL nodes have seen Phase 1 and ACKed it. 
pA Mt 3; Now is the time to send Phase 2. 
0638 31 pA ; Be BRW SEND_PH2 
0A86 6 3; At the completion of sending Phase 2 messages, this location 
= ? bg 3 is executed as a thread. 
Dab 09 JOIN_FINISH: 
0A86 2310 FORM-JOIN FINISH: 
52 10 A4 DO OA86 11 MOVL CLUBSL_LOCAL_CSB(R4),R2 ; Local node CSB 
008C C2 OCEC C4 20 28 OA8A 315 MOVC3) #CSB$S_NOD .7 3; Copy membership map from CLUB 
OA9 31 CLUBSB_NODEMAP(R4), - ; to local node's CSB 
QA9 32 CSB$B_NODEMAP(R2) 
F56B° 30 OA9 15 BSBW CNXS$SCAN_CSBS ; Iterate over all CSBs 
2A 50 E9 QAI 316 BLBC R ; Branch when done 
24 60 A311 «~E1 «(0A98 «2317 BBC #CSBSV_SELECTED, - : Branch if not selected 
OA9D 318 CSBSL_STATUS(R35 ,10$ 
1F 60 AS 18 £0 OA9D 19 BBS #CSBSV_LOCAL, - ; Branch if local node 
OAA 0 CSBSL_STATUS(R3) ,10$ 
18 BB OAA 1 PUSHR “M<R3,R4> ; Save registers 
oos8c c3 OOEC C4 20 28 QAAS § MOVC3) #CSBSS_NODEMAP, - ; Copy membership map from CLUB 
OAAC § CLUBSB_NODEMAP(R4), - ; to selected node's CSB 
QAAC 4 CSB$B_RODEMAP(R3) 
18 BA OAAC 25 POPR #*M<R3,R4> ; Restore registers 
0—E 60 AS 00 €1 OAA 6 BBC #CSBSV_LONG_BREAK, - :; Branch if no long break 
OAB 7 CSBSL_STATUS(R3),10$ 
52 10 A4 0 OAB 8 OVL CLUBSC_LOCAL CSB(R4) R2 ; Get local CSB address 
50 4C A3 f 0AB? 9 MOVZWL CSB$W_CSID_IBX(R3) RO 3; Remote node CSID index 
00 008C C2 50 F OABB 0 BBCC RO, CSB$B_NODEMAP(R2) ,10$ ; Mark connection broken 
5 pac 1 10$: SB 
F538° 8 ats 4 20$: BSBW CNXSFIX_EPID ; Add node ID to EPIDs 
0898 AC 4 BSBW UPDATE_GUORUM ; Update quorum, votes, nodes 
F535*° 30 OAC8 5 BSBW CHKSSCAN_CSBS ; Iterate over CSBs 
28 50 +€9 OACB 6 BLBC R $ ; Branch when scan is done 
1D 60 AS 611 ~=2E1 =—OAC 7 BBC acSesv ant - ; Branch if CSB not selected 
AD CSBSL_STATUS(R3) ,40$ 
13 60 AS 01 #4#=.EO OAD Bes - ; Skip if node is already a member 
AD 4 CSBSL_STATUS(R3) , 308 
08D1 AD 41 BSBW ADD_NODE 
0B 60 AS 18 «€1 OAD $5 BBC eCsesv LOCAL, = ; Branch if not local node 
AE 4 CSB _STATUS(R3) , 30S :; _ and skip outputting message 
>. a 44 AE 44 MOVL R3,R ; Address of CS 
50 000' CF E—E OAE 45 MOVAB ADONODE _MSG,RO ; Node added to cluster message 
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v04-000 CNXSRCVD_EN : Received a etuster memb 5- ets 84:69:29 YSYSLOA. SREICONMAN. MAR: 1 . 2°) v0 
FR) . 3 AE BSBW CNXSCONFIG_CHANGE : Make this state known 
F 4 . 3 ~ 30$: BsBu ENESRARK _URLOCKED ; Mark the CSB unlocked 


20 60 AS =—01-~—S—siE ; Branch on error case of non-selected 


#CSBSV_MEMBER, - : 
CSBSL_STATUS(R3),100$ : member 


60$: BSBW CNXSDIRVEC_F ; Update contents of lock manager directory 


4 ILL : 
5 ; INCW CLUBSW_MEMSEQ(R4) ; Advance membership state sequence number 
° ; Add Local node to cluster 
0D 1¢ AS =6—00~—C—iséER? : 
1¢ A& 10000000 8F C8 1 
00 1C AS «612~—~«2€ES 
aE 30 5 
731 6 
7 
8 


BBSS #CLUBSV_CLUSTER, - ; Mark node a cluster member and 
CLUBSL_FLAGS(R4S ,90$ ; branch if a member already 
BISL2 #CLUBSA_QUORU ; New nodes assume a quorum 


cLUBSL FLAGS(R4) 

BBCC #CLUBSV_NO_FORM, - ; Clear formation inhibit bit 

CLUBSL_ FLAGS (R45 .90$ 

90$: BSBW CNXS$MEMBERSHIP_CHANGE ; Do processing for adding a node 
BRW UNLOCK_ALL Make sure all nodes are unlocked 


100$: BUG_CHECK CNXMGRERR,FATAL ; Consistency check -=- unselected node is me 


s 

C 

F507" 
QOAC C4 BS 8 
0 

0 

0 

0 

0 
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4 4 ~SBTTL ADJUST_QUORUM = Adjust Cluster Quorum and/or Quorum Disk Membership 
B1 re p++ 
B1 73; 
0819 fe ; FUNCTIONAL DESCRIPTION: 
B19 6 : This routine adjusts the cluster quorum and/or changes quorum disk membershi 
6813 oe 3 This is done in a synchronized manner using a 2 phase protocol. 
13 4s 3; CALLING SEQUENCE: 
p81 ; JSB ADJUST_QUORUM 
be19 3 IPL is IPL$_SCS 
0B19 4 ; INPUT PARAMETERS: 
0B19 $2 ; 
0B19 § : NONE 
0819 § 3 
0B19 3 8 ; OUTPUT PARAMETERS: 
0B19 89 ; 
0B19 90 ; NONE 
0B19 91; 
0B19 38 ; COMPLETION CODES: 
0B19 2393; 
0B19 2394 ; NONE 
0B19 2395 ; 
0B19 2396 ; SIDE EFFECTS: 
0B19 2397 ; 
0B19 2398 ; RO-R5 are destroyed 
0B19 2399 ; 
0B19 2400 ;-- 
0B19 2401 
pai? $86 ADJUST_QUORUM: 
0085 30 19 240 BSBW INIT_TRANSITION : Initialization for becoming coordinator 
5B AG 6004—Cls«O pee 404 MOVB #CLMCNXSK_XTN QUORUM, - ; RECONFIGure transaction 
0 2405 CLUBSB_CUR_COBE (RA) 
55 D4& 0B20 2406 CLRL ; No CSB address 
50 0000'CF 43 0B § 407 MOVAB QUORUM _MSG,RO ; Initiating cluster reconfiguration message 
F4D6' ; 408 BSBW CNXSCONF IG CHANGE ; Make this state known 
F403" 30 A 2409 BSBW CNXSSCAN_CSBS 
08 50 =€E9 D 2410 BLBC 20 : Branch when done 
05 60 A301 E171 0B30 2411 BBC #CSBSV_MEMBER : Ignore nodes that are not members of 
0835 aie CSB$L_STATUS(R3),10$ : the Local cluster 
00 60 AS «(11~—séE 5 241 BBCS #csBs?_s LESTER - ; Mark node selected 
A 2614 CSBSL_STATUS(R35 ,10$ 
05 A 2415 10$: RSB 
B 718 
rd 20$: 
‘19 ; Selected nodes are all members of the cluster. 
O5F9 630 : 2 1 BSBW LOCK_NODES ; Attempt to lock selected nodes 
E 24 ‘ 3; Get here when all nodes in the cluster have been locked. 
4 : r : ; Compute and send Phase 1 proposal messages. 
F4BF* 30 E 2426 BSBW CNXS$QUORUM_CALC ; Calculate and store quorum related paramet 


CONMAN - Cluster Configuration Manager 16-SEP-1984 00:26: AX/VMS Macro V04-00 P 
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B41 ; RO is computed number of votes 
25 1C AS 1B. €1 Bee BBC tir ¥ evetResck Fe ts + Branch i? a quorum adjustnent requested 
O0AS4 C4 O00A6 C4 BD Bie MOVW it + TAB) AUORUACRED = :; Copy proposed value to new cell 
50 0O0A6 C4 Bi 0B4 CMPW § BSW-ADJ_QUORUM(R4),RO ; Rass value yich number of votes 
iF OB BLSSU 3; Branch new value would 
OOA4 C4 Be B MOVW R € UBSW_NEWQUORUM(R4) ; Use current number of votes 
8 c? : Ps 30$: st ig. ‘ 3; Compute (votes+2)/2 
50 O0A4 C¢ Bi Be CMPW C (osu. NEWQUORUM(R4),RO ; New quorum >= (votes+2)/2? 
if +4 BGEQU ap ; Branch if yes 
OOA4 C4 B B66 408 OVW RO, CLUBSW_NEWQUORUM(R4) 
60S: 
: Propose cluster -- Send Phase 1 Messages 


70 AS =6—0DCO9A 68 MOVZBL hay het a fMe QUORUM, - ; Message code 


78 AS) «OOBFA'CF soO9'E MOVAB ait: auORUM® MSG, - ; Address of routine to build 
Bsc, GTXT CRS) 3 status message 
04E7 30 BSBW SEND P ; Send phase 1 messages 


: Phase 1 has been sent. Nothing can stop us now short of our own 
3; failure. Therefore, it is time to clear the bit requesting the 
3 quorum adjustment. This node has done its best... 


BBCC #CLUBSV_ADJ_QUORUM ; Clear quorum adjustment flag 


00 1C AS) «= 1B~ CESS 
CLUBSL_FLAGS(R4), 160$ 


100$: 


ALL nodes have seen Phase 1 and ACKed it. 
3; Now is the time to send Phase 2. 


BRW SEND_PH2 


At the completion of sending Phase 2 messages, this location 
is executed as a thread. 


UORUM_F INISH: 
BSBW UPDATE _QUORUM ; Update quorum, votes, nodes 


Reduce quorum in CSB's to prevent eiuster quorum from ratcheting right 
back up with the next state transit 


O53—E 831 


Dee ee te te 


07EO 30 


F47A' BSBW CHS scan. cSBS 3; Iterate over CSBs 
15 50 BLBC : Branch when scan is done 
OF 60 AB 01 BBC Pcéaeye MEMB : Branch if node is cluster member 


CSBSL “status ), 2208 
CMPW ai tins QUORUM 


20 a4 «52 83” BI 
BsO aOUORUMCRGS 


— 
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05 18 9 BLEQU ; Branch if less than cluster quorum 
52 A35 20 A4 8B 9 MOV CLUBSW evomne R4), - ; Lower copy of sysgen parameter to match 
9 CSB$W_GUORUM(R3) > new, reduced cluster quorum 
F463' 30 9A 3108: BSBW ENKSRARE. OUNLOCKED : Mark node no lenger locked 
0 9D 20$: RSB 3; Continue iteration 


kK 1 
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FUNCTIONAL DESCRIPTION: 
This ceyetes is the common initialization code for all 
transitions. It is executed by any node which is attempting 
to become the coordinator. 

CALLING SEQUENCE: 


JSB INIT TRANSITION 
IPL is PLS SCS 


INPUT PARAMETERS: 
NONE 
OUTPUT PARAMETERS: 


R3: Address of local CSB 
R4: Address of CL UB 


COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO-R2,R5 are destroyed 


Eee | 


BAI 


at ant and and and ed eed ad aed me SD OODODOOOOOCOODOOOOOO@OMo 
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INIT TRANSITION: 
MOVL 


54 00000000'GF DO OBAI G*CLUSGL_CLUB,R4 ; Address of CLUB 
1¢ A4 =. 20000000 BF C8 OBA8 BISL2 M#CLUBSM_TRANSITION, - : Mark transition started 
088 CLUBSL_FLAGS(R4) 
0084 ¢c4 D4 O0BB0 CLRL pL USS TQE(R4) Abandon any timeout in progress 
50 O0CC C4 9E OBB4 MOVAB UB$B- FORK_BLOCK(R4), RO"; Address of transition fork block 
03 1c AO OO € BBG BBCC pcLOBr RBS FKB_BUSY 3 ‘Branch h if fork block is not 
BBE CLUGE EBS STATOS (ROS 198 busy and mark no busy 
50 60 OF OBBE REMQUE KBS$B- FORK -BLOCKER 5.hO ; Remove fron queue 
1C AS 00020000 BF CCA +3 10$: BICL sCLUBSA UALOCK? : Clear unlock request 
BC CLUBSL_FLAGS(R4) 
68 AS OD BC9 208: INCL UBSL_MAX_XTN(R4) ; Compute transaction ID 
FB 1 BCC BEQL $ 3; Disallow transition 
48 AG 68 AG 00 OBC MOVL § CLUBSL_MAX_XTN(R4), - 
BD LUBSL~CUR“XTN(R4) 
53 10 A&~ =O BD MOVL is tee OCAL_CSB(R4),R3 ; CSB for this node 
40 AS) «64C AS) ODO s«éOOBD MOVL CSB £ ID(R3), = ; CSID of coordinator 
BDC cues c gue COORD (R4) 
35 AG 33 0 BD MOVL R5,C t_COORD(R4) 3 Mark this node the coordinator 
AS = =20 +3 2 MOVB ACLNENNSK Lox ce cRe) ; Set transaction phase 
50 AS 00000000'GF 7D OBES 4 mOVa Me oo” SYSTIME, = 3 Current time ist timestamp for 
BEC 254 CLUB$Q “COR _TIME(R4) s transition 


4 1 
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64 AG 66 AG Bee te MOVW her tte W ett {MDExiNe). - ; Initialize CSID allocation context 

F40C" * Fi 8 BSBW CNX : Initialize CSB8s for transition 
00 60 AS 11 ~=«#€C F4 4 BBCS #CSB$V_S Ha 3; Mark local node selected 
BF9 348 CSBSL itis 5,308 
05 OBFO 2549 30$: R 
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FUNCTIONAL DESCRIPTION: 
This routine builds a message proposing the formation, reconfiguration, or 
addition of a node to us 
It uses the standard message building routine to build the message header. 
CALLING SEQUENCE: 


JSB BLD_FORM MSG 
JSB BLD mt hat MSG 


JSB L 
JSB BLD-QUOROM_MSG 
TPL is IPL$"SCS 


INPUT PARAMETERS: 


SOCOCOCOCOOCOOOOOOOOOOOSOOOOOCOSO OW 


R2: Address of message buffer 
R35: Address of CSB 

R4: Address of PDT 

R5 Address of CDRP 


CDRPSL_VAL1(R5): Byte 0 contains facility code (negated for response 
Byte 1 contains ete YA spec tt punetiion code 

CDRPS$L_VAL2(R5): Transition ID (from CLUBSL_C 

CDORP$L_VAL3(R5): Byte 0 contains transition” at Tien CLUBSB_CUR_P 


Byte 1 contains transition code (from CLUB$B_XTN_CO 
Byte ¢ contains success/failure flag 
Byte 3 contains reply code 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 


SIDE EFFECTS: 
RO and R1 are destroyed 
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LD_FORM 
LD “Reconrig: “MSG: 

A LD“JOIN_MSG: 

A LD~QUOROM_MSG: 

073 30 A BSBw BLO_STD_MSG ; Fill in standard fields 
007C¢ 8 D PUSHR #*M2R2,R3,R4,R5,R6> ; Save registers 
56 64 ASOD 1 MOVL CSBSL ELUB (RS) .R6 : Address of CLUB 
14 A2 6406 B 5 MOVW CLUBSQ NEXT CSID(R6), - : Save CSD assignment context 
A CLMPROSW_NERT_CSID(R2) 


B 2 04-00 Page $7 
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Se BLD-QUORUMLASG © Bulla Message Proposing ‘S-SEP=1984 Ou:09:29 FeYSLOA.SRCICONMAN HAR: 1 
MOVW CLUBSW_NEWQUORUM(RS), = ; Cluster quorum 

ee e0 i MOVW CLUBS RERSEGtRO). - ; Cluster membership state sequence 
ee iene to Et HE TY RREGRER SAR”: Seremiris nae sno 
faye oat 3 a FRIBER HRERLL SMe caster founding tin 

pret aeted ix tai eis sat shoregeat Ui he _ ; Store current system time in 

wwe oo ae 00 FERS HEIR ow FERRO EEUR TE nen erie ae 
U a 
ae SMR Se a Mov ELHPROSU-QDVOTES CRED 
so ag oe SEE Seg cunwEERPRORBEEAGS TRG): Sere SEPP BMS, a not part of 
a oa 28 a SB Sime ode ; Mark quorum disk present 
aa a : g x C3 HELMEROSS. FSeSi0 . ; Cluster founding system 
Re ee Oe ek eee Bees ESYSID(RGS , = 
ac49 3 MOVL Sys peapmanten ; Restore message oak ns wt 
52 GE =O OCS NODEMAP, - _; Fill map of proposed system 
sr na omec CED RES HERONS CLARO uray = 
OC4A 2631 CLMPROSB_NODEMAP(R2) = ER I 
007C 8F BA OC4A 263 POPR A*MCR2,R3,R4,R5,RO> ——«;_ Restore reg 
05 OC4E 35 RSB 
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; FUNCTIONAL DESCRIPTION: 
This routine is called cluster formation prepeses message is received. 
A eto gy ¥4 must be sent which ACKs or NAKs the request. The 
request is NAKd if this node does not have a connection to all proposed 
; member nodes. 
; CALLING SEQUENCE: 


JSB CNXSRCVD_FORM 
IPL is IPL$_SCS 


; INPUT PARAMETERS: 
Sh Message address 
R35: CSB of sending system 
R4: POT address 
RS: CORP address (uninitialized) 
; OUTPUT PARAMETERS: 
NONE 
; COMPLETION CODES: 
NONE 
; SIDE EFFECTS: 


RO-R5 may be destroyed. 
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CNXSRCVD_FORM:: 
USHR #*M<R2,R3,R5> 


; Save needed registers 
CNXSINET_EDRP 


; Initialize the CDRP for the response 
; Restore message address 

; Validate message 

; Save CSID assignment context 


64 A4 8614 A2- BO CLRPROSU. NEX 
OOAS C4 16 A2~ BO 
OOAC C4 18 A2-~ B0 
OOA8 C4 1C A2~ 00 

2C AS 8620 A2 7D 
0094 (4 28 A2 7D 

46 AG 1A A2- BO 


1C A4 04000000 8F CA 


- ; Cluster quorum 
- ; Cluster membership state sequence 


3 _ number 
2), - 3: Proposed cluster figure of merit 


2), - ; Save time from message 
- ; Quorum disk votes 
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2). - 3; Cluster foundation time 
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Ww _NEWQDVO 

BICL #CLUBSA_ QF ah 
GS(R 


; Assume no quorum disk membership 
CLUBSL_FLA 


o 


<- 


es 4-00 Page 59 = 
ion Manager 16-SEP-1984 00:26: AX/VMS Macro VO ; 9 
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= ip 
#CLMPROSV_QF VOTE, - ; Branch if no quorum disk membersh 
ee oe ey i i rp EC RPROSB_FLAGS(ROS ,108 PORE A 
4 LRL : 
mica OE gt 63s Ee hain. a> fod relct een 
00 1C AS «(1A «CE2 8 839 BBSS Eee eaten oe ; Set quorum disk membership 
2h 838 <McRO- : ; Save registers 
1¢ C9A 99 10$: PUSHR & nee R5,R4> : v 9g : on 
] FSYSID, = ; Cluster founding syste 
26 AS = A206 Ft 3 i MOVC3 cLRPRO FavS16 (2), : 
L & 
kB RE Hh fom, Ehrcaleis eter sapere 
3 A DEMAP, - : Save map of cluster nodes 
avec co 37 a2 25 2B the 70s mov aclSRE NER, =): Sve ate, 
EAD : POPR PRR ie ; Restore registers 
tf - : tem time 
' “EXESGQ_SYSTIME 3; Save current sys 
85: telld see rgedBins 7 Be 18 wi CL UB80_NEVTIME REF (RA) i RX Lp 
711 VL P ; 
i £34 Hi at at BSBW CNXSSCAN_CSBS : gcerese over Sth CSBs 
ms a trai qt BBC. petty - : Branch if node not selected 
Oa3 11 €1 OCCT 271% BBC acsasv SELECTED ; 
va CC6 2715 CSBSL_STATUS(R3) ,40$ 
50 4C a3 3C aces 716 MOVZWL CSBSW_CSID_1DX(RS) ,RO CSID index Pai Se Rn 
we sic eee ocr af LAPROSB_NODEMAP(R2), -; cluster 
tH q : . break seen 
$V_LONG BREAK, - ; Branch if no Long brea 
a Oc : ; — (SASL STATS CR ),40$ 
F337" 1 te ; ; BRU CNXSSCAN_CSBS_EXIT ; Exit from CSB scanning loop 
CD9 2724 . bit 
: # V_SELECTED, - ; Clear selected 
oagden Shy Eit Ocbe ; é ee: ees CSBSL STATUS (ASS , 408 
05 OCDE 2727 40S: RSB 
CDF 7 ; 
: 1 ; Save status 
7A2 20 30 8 abr ; ; ee skeet #0, #CLMPROSS NODEMAP, - ; Look for any missing nodes 
. CE6 731 C MPROSB_NODEMAP (R2) + SAS aadek eeeteneeil tee 
7 OR fee ; § Bbc” #CLUBSV_UNLOCK, - : Branch if no unlock request 
oe eer ences ED 734 CLUBSL_FLAGS(RA) , 60$ : a yon ; 
D 2735 CLRL : 
Be BRR He BE seit, | | RMSE TPS tell faseeeetrectory vet 
oo Bein ke ly, UREA Ber on nee 
2 D BA FB 20 708: POPR #*A<RO,R2,R3,R5> ; pestore seeder registers 
’ PUSHL R : Save statu 
50 $ R tre re MOVZBL #CLACNXSK Fe EGAN RO : ‘ iit Bm i hm wh 
a $ OD ' te eyTLe Hee ML eee Oar 3+2(R5) > Store success/failure flag 
sth Fas" 5 D 9 2745 BRW CNXSRESP_FORGET ; Queue response message 
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~SBTTL CNXSRCVD_RECONFIG = Cluster Reconfiguration proposal received 
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FUNCTIONAL DESCRIPTION: 
This rows tne is called when a cluster reconfiguration proposal 
message is received. 
A response must be sent which ACKs or NAKs the request. The 
request is NAKd if this node does not have a connection to exactly 
the set of member nodes of the proposed reconfigured cluster. 
CALLING SEQUENCE: 


SB CNXSRCVD_RECONF IG 


0 
C 
J 
IPL is IPL$_SCS 
INPUT PARAMETERS: 
sb Message address 
R35: CSB of sending system 
: R4: POT address 
; R5: CDRP address (uninitialized) 
; OUTPUT PARAMETERS: 
; NONE 
; COMPLETION CODES: 
R 
2 
CLUBSL_FRERIT( 
794 MOVCS #CLMPROS DEMAP, - ; Save nop. of cluster nodes 
E R2). - in CL 


NONE 
SIDE EFFECTS: 
RO-R5 may be destroyed. 
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NXSRCVD_RECONFIG:: 
PUSHR #*M<R2,R3,R5> 


Save needed registers 
pseu CXSINIT_ CDRP 


2c 
F2EF° 30 Initialize the CDRP for the response 
52 ‘ 3 gp Restore message address 
1C AG 00800009 8F 6CC 


00000000'GF 01 
OOA8 C4 =«1C A2 


OOEC C4 «6037 A2 = «20 


Validate message 
Mark connection to member Lost 


~Z°] 
om 


EQS ; Stall lock requests 
), > ; Proposed cluster figure of merit 
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79 CLUBSB_NODEMAP(R4 


Status indicator 

Message buffer address 

Iterate over all CSBs 

Branch when iteration is c lete 
Branch if node is not a cluster member 
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18 60 A3 1 
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covcvvccVvVcVvc cco °corcroror"r9o 


#1,R1 
MOVL  (SP),R2 
BSBW CNX CAN. CSBS 
; BBC #cSBSV_MEMBER, - 
CSBSL_STATUS(A3) , 108 
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BISL2 #CSBSM_SELECTED, - : Select 
ses status RBS elect every member 


4 
ROVEWL CSBSW-CSID_IDX(R3),RO ; Systen index : i 
; Branc member not r 
CLAPROSB NODEMAP(R2) , 108 ot In proposed cluster 


Ps) 
ma 
ac 


t 
vD_ 
D44 
D4C 
D 
it 
02 60 AS 00 €1 OD BBC #CSBSV_LON AK, = 3; Branch if no long break seen 
514 D A 1 CLRL CSBEL_STATUSURS), 108 F fail m ( 
3 For 
BS } 108: cue orce failure of proposa 
26 51 +€E9 OD 14 208: BLBC 1,258 ; Branch on previous decision t t 
OOAS C4 16 A2 60 6 1 MOVW CLAPROSW QUORUM (R - ; Store querun ad : =e ae 
D 1 CLUBSW_NEWQUORUM ( 
46 AG 1A A2 B80 OD 1 MOVW CLMPROSW_QDVOTES( ; 
D 1 CLUBSW_NEWQDVOTES(R4S 
1C A4 04000000 BF CA 4 1 BICL eCLUSSA GF LNEWYOT - 3; Assume no quorum disk membership 
0A 30 A2 00 €E1 D7 BBC #CLMPROSV_OF yors ; Branch if no quorum disk membership 
D7 CLMPROSB_FLAGS(R2S ,23$ 
07 1C A401 E1 007 BBC #CLUuBSV_GF ACTIVE, - ; Branch if disk not locally active 
D7D CLUBSL FLAGS(R4),24$ =: and reject proposal 
00 1C AS «1A =E2 0D7 BBSS #CLUBSO_QF NEWVOTE - 3; Set quorum disk membership 
D8 SLUBSL_FLAGS(R4), $$ 
02 #11 4 23$: BRB $ 
51 D4 OD ges: CLAL Ri ; Reject proposal 
51 Be D § 5$: PUSHL R11 ; Save status return 
37 A2 «20~—Ss(«é00 D SKPC #0,@CLMPROSS NODEMAP, - ; Look for any missing nodes 
D8 MPROSB_NODEMAP (R2) 
04 8613 : ? ; ALL nodes accounted for 
D 


BEQL : 
BUG_CHECK CNXMGRERR,FATAL ; Some non-member node proposed as member 
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$f E9 (SP) ,70$ ; Reject proposal as inconsistent with local 
2A 1C AG «O11~—Ss«éEO BBS #CLUBSV_UNLOCK, - : Branch if unlock request 
CLUBSL_FLAGS(R4),60$ =: is pending 
£265" 30 CNXSOPT ; Try to compute better subcluster 
03 5 E9 40$ ; Branch on computation failure 
21 3 58 : $ ; Branch if a better cluster was computed 
F259° DIRVEC_ADJ ; Adjust size of lock manager directory vect 
1B é § 60$ ; Branch on failure 
F253" 3 SRCAN_CSBS ; Iterate over all CSBs 
17 5 E 70$ 3; Branch when iteration done 
OF 60 AS O01 ET BSV_MEMBER, - : Branch if system is not a member 
$L_STATUS(R3) ,50$ 
50 4C Ad 3 $U"CSID_IDX(R$),RO _; System ID index 
05 QoeC c 60650 Ci*éE BBS LOB RODEMAP(A4),50$ ; Branch if system is in proposed cluster 
60 AS 1 E BBCC BSv_SECECTED, - 3 Clear selected bit 
$L_STATUS(R3S ,508 
05 50$: RSB ; End of iteration step 
—E 04 + CLRL (SP) ; Failure -- reject proposal 
BA $: POPR #*A<RO,R2,R3,R5> ; Restore status and needed registers 
i) PUSHL RO ; Save status 
50 A MOVZBL #CLMCNXSK_FNC_RECONFIG,RO : Facitit specific function code 
05 BSBW = CNXSINIT STD_RESP : Init CORP for s andard response 
36 AS 3 F (SP)+ CDRPSL-VAL3+2(R5) ; Store success/failure flag 
F228" 3 CNXSRESP_FORGET ; Queue response message 


2) 
RS 
Re? - ; Store quorum disk votes 
E, 
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-SBTTL CNXSRCVD_JOIN = Cluster node addition proposal received 
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FUNCTIONAL DESCRIPTION: 


A response must be sent which ACKs or NAKs the request. 
request is NAKd if this node does not have a connection to all proposed 
member nodes. 

CALLING SEQUENCE: 


JSB _CNXSRCVD_JOIN 
IPL is IPL$_SCS 


INPUT PARAMETERS: 


500909090909 0909 090909 SI NINN NINN INNO AA AOOAODO 
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This routine is called cluster node aaddition proposal mepeoge is received. 
e 
Re: Message address 
R35: CSB of sending system 
R4: PDT address 
RS CORP address (uninitialized) 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
2 NONE 
4 SIDE EFFECTS: 
9 RO-R5 may be destroyed. 
a 
38 CNXSRCVD_JOIN:: 
0 oD 9 PUSHL #0 3 Anticipate NAK 
C ? PUSHR #*M<R2,R3,R5> ; Save needed registers 
F221" 9 BSBU «= CNXSINIT_CDRP : Initialize the CDRP for the response 
52. 6€ 4 9 § (SP),R ; Restore message address 
0564 BSBW mSG_CHECK 3; Validate message 
03 1C A& 17 ~«€1 9 3 BB oC DSS¥ LOST Eiko ; Branch if node addition not inhibited 
gong 31 $ BRw - ‘ 3; Helper branch when node addition inhibited 
64 AG 144A B0 907 108: MOVW CLMPROSW_NEXT CSID(R2), - ; Save CSID assignment context 
9 : CLUBSW NEXT CSID(R4) 
OOAC C4 18 A2~ B80 9 MOVW CLMPROSW MEASEQ(R2), - ; Cluster membership state sequence 
319 CLUBSW_MEMSEQ(R4) 3 number 
1A 1C AG = 00~—=«=CEO 1 BBS #CLUBST_CLUSTER, - ; Branch if node is already a cluster member 
19 CLUBSL_FLAGS(R45 ,30$ 
if : Receiving node is not cluster member 
20 Ab «620 A227 916 ; MOVQ CLMPROSQ_FTIME(R2), - ; Cluster foundation time 
4} CLUBSQ_FTIME(R4) 
0094 (4 28 A2 7D 18 MOVa CLMPROSQ_CURTIME(R2), - ; Save time from message 
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; Save current system time 


voe-000 CNXSREVD. JOIN 
009C C4  00000000'GF 7D mova GPENESGO STSTIME, « 
26 AG «31 A2 «(068 MOVC3 stiuese™Fay ipo ; 
ase 
"et 2 seal a 27 
oo ae MRA 80 MOVY  CLMPRO QdvOTES(R2) « -; 
Gone c& 16 2 now fERBRaRMERRBEENE RSS 
1C AS 04000000 8F CA BICL bttues ate ° H 


0c 30 a2 «(00~—C—ié#€‘ BBC #CLMPROSV_GF 


VOTE, = 
ELRPROSB_FLAGS (RES ,358 


BBC #CLUBSV_QF ACTIVE, - 

cLUBSL FLAGS (R4) ,60$ 
#CLUBSV_QF NEWVOTE, - 
CLUBSL_FLAGS(R4), 35S 
35$:  MOVC3 #CLUBSS_NODEMAP 


4210 a6 «(01 —CO#E? 
00 1C AG «(O1A.s«CO#2 

OOEC C46 «037 AZ 20séB 

CLUBSB_NODEMAP(R4) 

(SP) R2 

MOVL =e «#1 RA 

CNXSSCAN_CSBS 

RO, 60$ 

#CSBSM_SELECTED ! - 
CSBSA MEMBER, - 
SBSL_STATUS(R3) 

#CSBSM SELECTED - 
CSBSL_STATUS(R35 

¢ B$W~CSID_IDX(R3),RO 

CLAPROSB_NODEMAP(R2), - 


BBC #CSBSV_LONG BREAK, = 
R3),50$ 
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1F 3 
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CSBSL_STATUS( 
51, pe CLRL 
F186" 31 % BRw CNXSSCAN_CSBS_EXIT 
40$:  BUG_CHECK CNXMGRERR,FATAL ; 
05 964 50S: RSB 
OC AE 09 966 60$:  MOVL R1,12(SP) 
07 BLBC ; 
37 A220 SKPC #0, #@CLMPROSS_NODEMAP, - : 


ESS 


RPROSB_NODERAP(R2) : 
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1 BNEQ 
5 44 70$ BLBC = 12( SP), 808 
FI 7 BSBY 836s CNX JRVEC_ADJ 
04 £ 97 BLBS = RO, 
OC AE D 97 VL 
BA 97 


RO. 12(SP 
F ACAD RS.RSD 


as a reference 
Cluster founding system ID 


Restore registers 
Quorum disk votes 


; Cluster quorum 


Assume no quorum disk membership 


; Branch if no quorum disk membership 


Assume failure 

Branch if disk not locally active 
and reject proposal 

Set quorum disk membership 


wd ; Save map of cluster nodes 
CLNPROSB_NODEMAP(R2), - 2 in CLUB 


Restore message address 
Anticipate success 
Iterate over all CSBs 
Branch when done 
Check for SELECTED or 
MEMBER 
Branch and ignore if neither 
Mark the node selected 
CSID index 
Branch if node is not in proposed 
cluster 


Branch if no long break seen 


; Flag failure 
; Exit from CSB scanning loop 


Consistency check 


Save status 
Branch if NAK required 
Look for any missing nodes 


Some node(s) is not accounted for 

Branch on NAK pending 

Adjust size of lock manager directory vect 
Branch on success 

Make sure proposal is NAKed 

Restore needed registers 
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50 9 A .] MOVZBL ecL OC WEEK FNC_JOIN,RO : Facility specific function code 
0466 5 ER 38 BSBW rare WXSINTT T_STD “atse ; Init coke Tor atendere response 
36 AS 3 F EA 378 CVTLB CORPSL~ pre tas i; Store success/failure flag 
F156" 3 EA 97 BRW CHKSRES Sp. FORG ; Queue response message 
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~-SBTTL CNXSRCVD_QUORUM = Quorum Update Message Received 
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FUNCTIONAL DESCRIPTION: 
This routine is called when a quorum update request message is received. 
This is a@ Phase 1 message. The validity of the message is checked and 
the new quorum value is saved in a temporary location. 

CALLING SEQUENCE: 


JSB CNXSRCVD_QUORUM 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
ae Message address 
R35: CSB of sending system 
R4: POT address 
R5 CORP address (uninitialized) 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 


RO-R5 may be destroyed. 
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Pus #*M<R2,R3,R5> ; Save needed registers 
BSBW CXSINIT_ CDRP : Initialize the CDRP for the response 
mova ; Restore message address and CSB address 
0494 BSBW MSG_CHECK 3; Validate message 
vy BSBW CNXSSCAN_CSBS ; Iterate over all CSBs 
5 E BLBC $ : Branch when done 
05 60 AS 01s BBC #CSBSV_MEMBER, - : Branch if not a member node 
csBst STATUS (R3), 10$ 
00 60 AS 11° ~«€2 BBSS #cses? sete cTee ~ : Select each menber 
CSBSL_STATUS(R3) ,10$ 
05 10$ RSB 
7D 20$ mMOVa ; Restore message buffer address 


52. 6 H 
00A4 (4 16 3 B0 ; Temporarily save new quorum value 
46 A4 1A A2~ B60 


1C AS 04000000 BF CA 


2), - 
R4S 
R2), - ; Quorum disk votes 
CLUBSW_NEWQDVOTES (R45 
BICL  #CLUBSA GF ANEW E, - 


CLUBSL_FLAGS (R4) 
° 3; Assume fhat we will accept proposal 
BBC #CLMPROSV_QF_VOTE, - ; Branch if no quorum disk membership 


R 

CLUBSW_NEWQUORUM ( 

MOVW CLMPROSW Heb Hf 
T 3; Assume no quorum disk membership 
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guration Manager 
- Quorum Update Message 


CLRL 
BBC 


MOVL 
BBSS 


POPR 


PUSHL 
MOVZBL 
BSBW 
CVTLB 
BRW 


BABA BEDE RAUME Maser P88" Gy 
CLMPROSB_FLAGS(R2) .508 


#CLUBSV QF ACTIVE 
¢ UBSL_FLAGS(R4), 


#CLUBSV_QF NEWVOT 
CLUBS, FLAGS (RS). 
aaa oR3S,R5> 
#CLMCNXSK_FNC_QUORUM,RO 
C I D_RESP 

)+, CDRPS$L"VAL3+2(R5) 


Assume failure 

Branch if disk not locally active 
and reject proposal 

Accept proposal 

Set quorum disk membership 


Restore needed registers 


Save status 
pega try specific function code 
Init CDRP for standard response 


Store success flag 
Send response message and forget it 
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-SBTTL BLD_VEC_MSG = Build Message Describing Vector Slot 
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; FUNCTIONAL DESCRIPTION: 

This routine builds a message describing an empty cluster vector slot. 
This is needed in order to guarantee consistent, cluster-wide assignment 
; of unique CSIDs. 

: CALLING SEQUENCE: 


JSB BLD_VEC_MSG 
IPL is IPL$_SCS 


; INPUT PARAMETERS: 


R2: Address of message buffer 
R35: eacress of CSB 


Byte 1 contains facility specific function code 
: Transition ID (from CLUBSL_CUR_XTN) 
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; RP 

3 R5): Byte 0 contains facility code (negated for response 
; CORPSL_VAL2(R5) _XTN 

3 CORPSL_VALS5(R5): Byte 0 contains transition phase (from CLUB$B_CUR_P 
: Byte 1 contains transition code (from CLUB$B8_RXTN_CO 
; Byte § contains success/failure flag 
° Byte 

I} 


; contains reply code 
: OUTPUT PARAMETERS: 

NONE 

; COMPLETION CODES: 

NONE 

; SIDE EFFECTS: 


RO and R1 are destroyed 


BLD hag re 3; Fill in standard fields 
9 PSL VAL (R5),RO 3; Slot index 
38 CVTLW RO,CLMVECSW INDEX(R2) =: Store slot index 
9 v fy Gt _CLOSVEC.RI : Address of cluster vector 
9 MOVL (R1)CROIJTR ; Get contents of slot 

10$ ; Branch if slot in use 

§ W RO, CLMVECSW_SEQUENCE(R2) ; Last sequence number used 
i 10$ ; Branch on overflow 
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RSB 
10$: BUG_CHECK CNXMGRERR,FATAL ; Consistency check 
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FUNCTIONAL DESCRIPTION: 

is rece 

No response or immediate acknowledgement 
CALLING SEQUENCE: 


JSB CNXSRCVD_VEC 
TPL is IPL$_SCS ~ 


INPUT PARAMETERS: 

ae peste e address 

POT address 

OUTPUT PARAMETERS: 

NONE 
COMPLETION CODES: 

NONE 
SIDE EFFECTS: 

RO-R5 may be destroyed. 
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AX/VMS Macro V04-00 


SYSLOA.SRCJCONMAN.MAR; 1 
-SBTTL CNXSRCVD_VEC = Cluster vector slot information received 


This ae ihe is called when a cluster vector slot description 


is sent. 


; Validate message 


s of cluster vector 


3; Deallocate message buffer 


6SBW  MSG_CHECK : 

MOVL G*CCUSGL_CLUSVEC,R : Addres 

MOVZWL CLAVECSH tte Rl: Slot 

CMPW = -R1,G*CLUSGW_MAXINDEX ; Valid 

BGEQU 108 : vin vali 

MOVZWL CLAVEC$¥_SEQUENCE(R2), ~ 

(RO)CR1 

BSBW CNXSDEALL_MSG_BUF_CSB 

RSB ; Return 
10$:  BUG_CHECK CNXMGRERR, FATAL ; ‘onsis 


tency check 
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ex 
; Store last used sequence number 
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; FUNCTIONAL DESCRIPTION: 
This routine tells one node about another node. It returns 
asynchronously with information indicating that the first 
node can or cannot see the second node. 

CALLING SEQUENCE: 


JSB DESCRIBE_NODE 
IPL is IPL$_SCS 


INPUT PARAMETERS: 


R5 is address of a CDRP 
R3 is CSB address of node to talk to 


= Py a oe we we we ee 
Sete Ge 


R2 is CSB address of node to describe 
OUTPUT PARAMETERS: 
R5 is address of a CDRP 
R3 is CSB address of node talked to 
R2 is CSB address of node described 
COMPLETION CODES: 
RO indicates that a response was received from 
the node vs. connection failed 
R1 is status received from the node. 
SIDE EFFECTS: 


CDRPSL_VAL1=CDRPSL_VAL5 are used for this routine's context. 
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DESCRIBE_NODE: 
on 30 6SBW CNXSINIT_CDRP : Initialize the CDRP 
54 644A D MOVL CSB$L_CLOB(R3) ,.R4 ; Address of CLUB 
38 AS.) 5 D MOVL R2,CDRPSL YALG{RS) 3 Node to describe 
3c AS 8E POPL  CDRPSL yAC (R5) ; Return address 
50 (0 A MOVZBL A#CLMCNRSK_FNC_DESC,RO =; Message code 
0382 0 BSBW INIT_STD_ASG ; Do standard message initialization 
20 AS 01 0 MOVL #1, CBRPSC_RSPID(RS) i: Indicate that response is needed 
4C AS B87°AF 9E MOVAB B*BLD DESC_MSG, - : Address of routine to build 
CORP$C_MSGBLD(R5) 3 status message 
F094* 30 BSBW CNXSSERD_MSG_CSB : Send message 


We are resumed here when the response message arrives. 
Registers contain: 
RO: Status 
Re: Address of message buffer 
R35: Address of CSB 
R4: Address of PDT 
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AN - Cluster Configuration Manager 16-SEP-1984 00:26: AX/VMS Macro V04-00 Page 70 
v04-000 DESCRIBE _NODE = Descr be one node to ano ~$Fb=1 384 BR 89:39 SYSLOA.SRCJCONMAN.MAR; 1 . (BM) 
‘ f 1g ; R5: Address of CDRP 
11 5 3 F6C 14 BLBC RO,10$ : Error sending message 
7E 124A A OF 15 MOVZBL C ACNX$B_ACK(R2) ,=(SP) ; Response from remote node 
5 bp F 19 PUSHL ; Save return status 
F088" F 1 SBW CNXSDEALL_MSG_BUF_CSB ; Release message buffer 
F7 1 DEALLOC_RSPID ; Deallocate response ID 
0 BA 443 POPR #*Mh<RO,R1> ; Restore status and return ACK/NAK 
52 3 A Dd Fe 10$ MOVL tate 4 VAL4(R5) ,R2 ; Address of described CSB 
C85 617 «(OFB4 JMP SCDRPSC_VAL5S (R55 ; Return address 
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-SBTTL BLD_DESC_MSG - Build Message describing a node 


+ 
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FUNCTIONAL DESCRIPTION: 


CALLING SEQUENCE: 


JSB BLD_DESC_MSG 
IPi is IPL$_SCS 


INPUT PARAMETERS: 


CORPSL-VAL3( 


OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO and R1 are destroyed 


BLD_DESC_MSG: 
BSBW BLD_STD_MSG 
MOVL CDRPSL_QAL4(RS) 

VL  CSBS$L_SB(RO),R1 
PUSHR #*M<RO,R1,R2,R3 
vc3 FCLMNOOSS SYSTE 
SBSB_SYSTEMID(R 
CLANODSB SYSTER 
POPR #*M<RO,RT,R2,R3 
MOVG SB$Q_SWINCARN(R 
CLMNOD$Q_SWINCA 

MOVL  CSBSL_CSTD(RO) 
CLMNODSL_CSID(R 


R 
R5 

CORPSL_VAL2(R5): 
R5 


CDRPSL_VAL4 (RS): 


This routine builds a message Geace tb ing anode. It uses the 
standard message building routine to build 


the message header. 


R2: Address of message buffer 
R3: Address of CS5& 

R4: Address of FOT 

R5 Address of CD 


Byte 5 contains reply code 
Address of CSB to describe 


Fill in standard fields 
Address of CSB to describe 
Address of SB of described system 


4,R5> Save registers 
..- Fill in described system ID 
{r2) 
4,R5> ; Restore registers 
= ; Fill in described systen 
{r2) ; sof tuare ncarnation number 
; Described system CSID 
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FUNCTIONAL DESCRIPTION: 


vO4-000 CNKSREVD-DESC © Node Geseription receiv S-SEP-198e 04:69:29 


teed 


AX/VMS Macro V04-00 
SYSLOA.SRCJCONMAN.MAR; 1 


- Node description received 


This routine is called when a node description message is received. 
A response ayes be sent which ACKs or NAKs the request. he 


request is NAK 
CALLING SEQUENCE: 


JSB CNXSRCVD_DESC 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
a Message address 
R3: CSB o 
aa POT address 


sending system 


f this node does not have a connection. 


CORP address (uninitialized) 


OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO-R5 may be destroyed. 


#°M<R2,R3> 
MOVL  CSBSL_§B(R3).RO 


SWINCARN -- it was created and intialized be 


: CNXS$RCVD_DESC:: 
ei 8 PUSHR #*M<R2,R3,R5> 
F054" 3 BSBW CNXSINET_CDRP 
52 6f 00 MOVL (SP) 
039 BSBW = MSG_CHECK 
55 bs CLRL 
F049! 9 BSBW § CNXSSCAN_CSBS 
2750 € BLBC OsséaR 
50 68 A3 DO OFBA MOVL  CSBSL $B(R3) .RO 
o¢ BB PUSHR #°M<R2.R3> 
14 A2 18 A0 06 CMPC3 #SBS$S_SYSTEMID, - 
SB$B SYSTEMID(RO), - 
CLANODSB SYSTEMID(R2) 
BA POPR #*M<R2,R3> 
BNEQ 
PUSHR 


became meaningful. 


Save needed registers 
Initialize the CDRP for the response 
Restore message address 
Validate message 
Result CSB address 
Iterate over all CSBs 
Branch when done 
Address of System Block 
Save message buffer and CSB address 
Compare System IDs 
between SB and 
incoming mess 


age 
Restore message butter and CSB address 


No match 
Save message buffer and CSB address 
Address of System Block 


3 Yoo SWINCARN out of SB because local node's ¢S8 doesn't contain a valid 


ore SWINCARN for the local node 
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: The described 
; Return a NAK. 


BICL2 


5$: CLRL 
0$: At 
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i SUINCARN, 
B$Q_SWINCARN(RO 
PNORNUINEABNtRd) | 


R3,R5 
CNXSSCAN_CSBS_EXIT 


RS R3 

3 $V_LOCAL 

CSBa STATUS(R3) , 108 
#CSBSV_STATUS RCVD, - 
csB SL STATUS(R3) ,20$ 
acsas? LONG hip ~ 
CSB’ __ STATUS(R3) , 20S 
#CSu A SELECTED - 
CSB$L_STATUS(R35 
CLMNODSL CS1D(R2), - 
CSBSL_CSTD(R3) 

#1,R 

30$ 
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; Compare software incarnation number 
B and 


etween CS 

ncoming Dg ~ 
; Restore message buffer and CSB address 
No match 
; Store re 


sul 
; Exit iterat on with result 
; Return and iterate 


CSB address of described node 
Described node not found 
Branch if local CSB 


; Branch if no status received 
; Branch if long break seen 


NAK request 


$n 
; Mark node SELECTED 


Save node identification 
for described node 
ACK node description 


node is unknown or no valid connection exists. 


#CSBSM SELECTED - 
CSBSL_STATUS(R35 


R 
#*A<R2,R3,R5> 


#CLMCNXSK_FNC_DESC,RO 
NXSINIT STD RES 

SP) + 
CNXSRESP_FORGET 


sone 
a FP 


E 
CORPSL VAL3+#2(R5) 


; Mark node deSELECTED 


NAK node description 


; Restore needed registers 
; Save status 


Hs ey specific function code 

P for standard response 
crore success/failure flag 

Send response message and forget it 
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+ 
+ 


FUNCTIONAL DESCRIPTION: 
as known to the local node. The description is optimist 


message. 
CALLING SEQUENCE: 


JSB BLD_TOPOLOGY_MSG 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
R2: Address of message buffer 
CSB 


R35: Address of 
: Address of PDT 


Byte 
Byte 


contains success/failure flag 
Byte 


contains reply code 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO and R1 are destroyed 
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BLD_TOPOLOGY _MSG: 
BSBW BLD_STD_MSG 
MOVL cSBSt CCUB(R3) ,RO 


MOVL CLUB F-LOCAL _C B(RO),R1 

PUSHR #*M<RO-RS.RGR 

MOVC3 #CLMTOPSS 
CSB$B_NODEMAP(R1). = 


Fill in standard fields 

Get CLUB address 

Local CSB Address 

Save registers 

Copy data into message buffer 
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; Restore registers 
; Return and iterate 
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This routine builds a message describing the connec vytty of the cluster 
c in that some 

connections that are reported as good may in fact be bad. The oppositve 

cannot occur. Information about the quorum disk is not passed in this 


RS: Address of CDRP 
CORPSL_VAL1(R5): Byte 0 contains facility code (negated for response 
Byte 1 contains Mey ty specific function code 
CDORPSL_VAL2(R5): Transition ID (from CLUBSL_CUR_XTN) 
CORPSL_VAL3(R5) 


0 
1 

: Byte 0 contains transition phase (from CLUB$B_CUR_P 
contains transition code (from CLUB$B_XTN_CO 
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-SBTTL CNXSRCVD_TOPOLOGY = Topology Request Message Received 
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FUNCTIONAL DESCRIPTION: 
This routine is called when a ,fopelogy request message 4 received. 
A cetying nod must be sent describes ghe yo vity seen by the 
rece node. The message itself is used to updat a receiving 
nodes* understanding of the sending nodes’ connectivity 

CALLING SEQUENCE: 


JSB CNXSRCVD_ TOPOLOGY 
IPL is IPL$_SCS ~ 


INPUT PARAMETERS: 


Re: Message address 
R35: CSB o anaes system 


RS: CDRP saan (uninitialized) 
OUTPUT PARAMETERS: 

NONE 
COMPLETION CODES: 

NONE 
SIDE EFFECTS: 

RO-R5 may be destroyed. 
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NXSRCVD 2 ae 
PUSHR gemcR2 R3,R5> ; Save needed registers 
BSB CSpy €pRP : Initialize the CORP for the response 
mova (SP),R ; Restore goto = address and CSB address 
BSBW 6 tH ep ; Validate mes $099 
MOVC3 pesess z Fill in connectivity in sending node's 
CcaTorse B NODEMAP(R2) ; ¢SB 
$B$B8_NO popener(R (R3) 
POPR #°M<R2 R5> ; Restore needed registers 
VL $L ELUB(R3) -R Fetch CLUB 
MOVZBL #CLMCAX$K_FNC_TOPOLOGY, Rb lity specific function code 
BSBW cnx INIT_STD_RESP ; Init chrp or standard response 
MOVAB BLp TOPOLOGY MSG, - ; ioe message build routine 
BORD C_MSGBLD(RS) 
BRw CNXSRESP_FORGET ; Send response message and forget it 
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if : re : -SBTTL SEND_PH1 =~ Send Phase 1 Messages 
ae 
’ . 
1O5F $4 : FUNCTIONAL DESCRIPTION: 
105F 3490 : Send a Phase 1 message to ast locked and selected 
105F 3491 ; notes. A response is required from every node. If ~ response 
105F 3492; s a NAK or oi | connection preants the transition is abandoned 
is : rt 3 without returnin ng to the cailer. 
i f 495 ; CALLING SEQUENCE: 
105F 199 ; JSB SEND_PH1 
i ; +38 3 1Pe is IPL$_SCS 
' . 
u f 0 : INPUT PARAMETERS: 
r) 7 
105F § 3 R4 is address of CLUB 
105F 3 CL toh ees CODE gives Rp nnn the type 
105F 4 ; CLUBSL_CTXO contains RO argument for INIT_STD_MSG 
: : : a CLUBSL-CTX1 contains message build routine address 
F ; 3 : OUTPUT PARAMETERS: 
F 03 : R4 is address of CLUB 
F 311 > COMPLETION CODES: 
193 $518; mone 
F 15 : SIDE EFFECTS: 
105F 19 : CLUBSL RET! is destroyed. 
105F 13 3 -R3,°R5 are destroyed. 
lose 3820 
105F 1 SEND_PH1: 
74 AG BEDO 105F ¢ POPL CLUBSL_RET1(R4) ; Save return address 
SA AG 4 106 CLRW CLUBSW a bee : Initialize waiting count 
59 AG) =e 440 «BF 106 4 MOVB #CLACN ; Mark this as Phase 1 
1 5 CL $8 CUR PPHASE (RS) 
r? . 38 1 § BSBW eax? ¥ ; Iterate over ott CSBs 
41 5 e&9 1 BLBC : Branch when don 
1860 a3 11 ~€1 1 : BBC i V_ SELECT ED : Branch if not selected 
16 60 AS 00 €0 1 BBS tty gS F 10s B h if tb k 
3: Branc ermanent brea 
1 ; tsp Fane eR ENS los == 5 tn ceonertion 
1160 a3 18 €0 1 § BBS é AL 3; Branch if local CSB 
1 CSB it STATUS (R3) , 108 
EF7D" ; 1 BSBw ©=- CNX SACLOC_WARM MCORP. CSB 
F7A‘ 1 BSBW cu eit ESOURCE CHECK 3; Watch out for sPunpusted resources 
50 €9 1 BLBC ; No memory available 
A “ 1 INCW C8 -MSGCNT(R4) 3; Include in wait count 
? 108C 8 8588 3; Describe nodes 
EFOF* ' ; i BRw CNXSSCAN_CSBS_FORK ; Fork and resume scan 
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05 ] 10$: RSB ; Return and continue scan 
EF6B’ 31 ! 27 208: BRW CNXSSCAN_CSBS_RETRY ; Delay and resume scan 
1 45 : 
! 28 i ; Send proposal to one node 
50 70 A4 1 48 30S:  MOVL —«CLUBSL CTXO(R4) ,RO : Facility specific messa 
ge76 H 1 3 28 BSB INIT_STD_M : Standard tbRP eee e IR fat fat ion 
40 AS 78 AG 00 109 0 MOVL CLUBSL_CTX1(R4) ; Address of rout o buil 
10A 1 CORPSL “RSGBLD CRS). > status message 
EFSC" 30 } ‘} ¢. BSBW CNXSSEND_MSG_CSB 3 Send message 
10A4 4 We are resumed here when the response message arrives. 
10A4 5; Registers contain 
10A4 § 3 R Status 
10A4 3557 ; Re: Address of message buffer 
10A4 238 : R3: Address of CSB 
10A4 3559 ; R4: Address of PDT 
: wr 269 3 RS: Address of CDRP 
O23F 30 bag 266 ; BSBW CNXSPROCESS_RESPONSE ; Deallocate storage, get status 
08 50 —=s«éE8 44 56 BLBS RO,40$ 3; Branch if ACK 
1C AS 00020000 8F CB I10AA 3564 BISL2 #CLUBSM_UNLOCK ; Request that all be unlocked 
108 263 CLUBSL "FLAGS (R4) 
138 567 3; terminate threads -- except for the Last one 
SA AGB? 188 369 dos: ecw CLUBSW_MSGCNT(R4) 
01 19 108 570 BLSS 50$ ; Branch when done 
05 is 3) RSB ; Terminate thread 
0179 «630 1988 378 50 50$ BSBW CNXSCHECK_UNLOCK 3; Check unlock request bit 
74 84 17 10BB 3574 JMP @CLUBSL_RET1(R4) 3; Return to caller 
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FUNCTIONAL DESCRIPTION: 
Send a Phase 2 notification to all locked and selected 
nodes. All messages are sent in parallel. Breaking 
connections are ignored. 

CALLING SEQUENCE: 


JSB SEND _PH2 
IPL is IPL$_SCS 


INPUT PARAMETERS: 

CLUBSB_CUR_CODE gives transaction type 
OUTPUT PARAMETERS: 

R4 is address of CLUB 
COMPLETION CODES: 
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AK 
CSB$L_STATUS(R3),10$ : in connection 
BSBW CNXSACLOC_CDRP_ONLY 
BSBW CHASRE SOURCE _CRECK 3 Watch out for exhausted resources 
RO,20 3 No memory available 


: Send Phase 2 to one node 


9 
$9 NONE 
3 SIDE EFFECTS: 
6 oe 
6 END_PH2: 
59 AS = 660 -BF 6 MOVB #CLMCNXS$K_PH2, - ; Set current phase 
6 CLUB$B_CUR PHASE(R4) =: into CLUB 
EF3A’ 8 6 BSBW CNXSSCAN css ; Iterate over all CSBS 
3F 50 .~=C*E BLBC DO_PHASE 3; Branch when done 
1f 60 a3 11.—« «ET é BBC #cseso SELECTED : Branch if not selected 
6 C st STATUS(R35 ,10$ 
1A 60 A3 18 €0 BBS #CSBSV_LOCAL, - ; Branch if local CSB 
6 cSBSL STATUS(R3) , 10$ 
15 66 Ad 00 €0 6 BBS #CSB$7_LONG B - : Branch if permanent break 
6 
6 
6 
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50 A A MOVZBL #CLMCNXSK_FNC_PH2,RO 3 Foc titty specific function code 
02 4 BSBW INIT 7 ; Setup CORP for sending message 
EF ¢ BSBW CNXSSEND-FORGET ; Send message and forget it 
EFIS*® 31 BRW CNXSSCAN_CSBS_FORK ; Fork and resume scan 
05 108: RSB ; Return and continue scan 
EFOF* 31 20$: BRW CNXSSCAN_CSBS_RETRY ; Delay and resume scan 


e 
fi i bead - 
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-SBTTL CNXSRCVD_PH2 = Phase 2 request received 


+ 
af 


FUNCTIONAL DESCRIPTION: 
This routine is called when a phase 2 request message is received. 
The transition jnorogress is committe 
No response or immediate acknowledgement is sent. 

CALLING SEQUENCE: 


JSB CNXSRCVD_PH2 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
sh Message address 
R35: CSB o sending system 
PDT address 


OUTPUT PARAMETERS: 


8 2 ss 


Pe eal at leas eal ales eal lr oP oP oP oe oo oe 


PAN OS ODNOA NEW OOD NAUSEA OUOODNOUL WW 


PAEQPERXALA AAA AAA AAA AAA A AO 


: Perform general transition completion operations 
bO_PHASE2: 
MOVL 


4 NONE 
4 COMPLETION CODES: 
4 NONE 
4 SIDE EFFECTS: 
Fi RO-R5 may be destroyed. 
F1 3665 == ' . 
Fi 366 
Fl 3667 CNXSRCVD_PH2:: 
54 64 A300 Fl AOVL CSBSL Cue (a R4 3; Address of CLUB 
07 1c AS) «61D)SCO«E~—s«*d10F SS 66 BBC #CLUBSV_ TRANSITION F Branch if not locked and 
FA CLUBSL FLAGS(RG) 168: bugche chec 
48 AG OC A2 ODI FA CLMCNXSL ID(R2), = ; Validate Srensect ten ID 
F UBSL_ COR. WTHeRes 
046 = «13 F BEQL $ 3; Branch on match 
} 10$: BUG_CHECK CNXMGRERR,FATAL ; Do something more sophisticated later? 
EEF8* 30 } 208: BSBW CNXSDEALL_MSG_BUF_CSB ; Deallocate message buffer 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 


CoCoCo CoCo CoCo OOOO INN NNN 
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34 AG «648 AG ODO CLUBSL_CUR_XTN(R4), - ; Copy current transaction info into 
CLUBSL-LST-XTN(R4) 
38 AG «640 AGO MOVL CLUBSL_CUR_COORD(R4), - 
CLUBSL_LST_COORD(R4) 
3c AS =6S0 AG OD 1 mova CLUBSQ_CUR_TIME(R4), - 
1 CLUBSQ_LST_TIME(R4) 
4406 SBAL 90 1 MOVB CLUBSB_CUR_CODE(R4), - 
1 CLUBSB_LST_CODE(R4) 


45 a6 S59 AG 90 1 
66 AS 86064 AG OBO 


a 
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ration Manager 


on - Cluster Configu 1 
v04-000 CNXSRCVD PHS = Phase requett received g- 


4 
CLUBSB"LST~P 4 

MOVW CLUBSW" NEXT 4 
CLUBSW~ “First: INDEX(RS) 


; Case on transaction type and branch to appropriate place 


SEP-1984 AX/VMS Macro V04-00 

-SEP- 71982 a ‘68: i SYSLOA. SRE tie CONMAN.MAR; 1 
MOVB cLUsse.. CUR etre t $4 ) 

HASE(R4) 

CSID(R4) ; Update CSID allocation context 


pore CLUBSB_CUR_CODE(R4) , TYPE=B, PREF IX=CLMCNXS$K_XTN_, = 


ry! aT FORM_ Ai Fd 9 Joining formation complete 
<JOIN, JOIN F INISH> ng be | pow complete 
<REC CONTIG RECONF 1G FINISH>, over complete 
<QUORUM, QUORUM_FINTSH>, = a &, 4 ustment complete 


BUG_ CHECK CNXMGRERR,FATAL ; Invalid transaction code 
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-SBTTL LOCK_NODES = Obtain Coordinator Lock on Selected Nodes 
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; FUNCTIONAL DESCRIPTION: 


This routine tries to obtain the coordinator lock on the 
selected nodes 
}be attempt fails if any node rejects the fequest or 

he connection to a — date node break Ss. 
- mmediate return is made to the caller's caller. 
If the locking operation is complete, a return is 
made to the caller 
If the locking operation fails, the transition is aborted 
a return is made; rather control passes to the unlock 
routine. 


CALLING SEQUENCE: 


LOCK NODES 
BL is IPL$_SCS 


INPUT PARAMETERS: 
CLUBSB_CUR_CODE gives trensaction type 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
If CSB is Locked the CSBSM_LOCKED bit in CSBSL_STATUS is set 


and the CSB$B_REF_CNT is incremented. 
RO-R5 are sootraia 


LOCK_NODES: 
MOVL 


ce ce ee me ee ee mm me ee ed ed od dd dd od dd 3 dd dd Bd dD 
ec ed a ed ed od = = 2 8 8 8 2 SS 2 —  — — — —) Ss 2 2 2 2 2 2 8 Lt 


PREGAME BBB BAIA AAAI WANK AAA WIA AIA AI AIA NIAAA AAAI AANA ANNA 


FAO NIM FBO OOD NNN 


4 
54 CO000080 "6 Dd ? COB R cL Ve R4 3; Address of CLUB 
4 A4 BED POPL CLUBSL_RET1(R4) : Save return address 
53 § MOVL etuBst LOCAL_CSB(R4),R3 ; Address of local CSB 
—EB7" BSBW CNXSMARK_LOCRED ; Mark local CSB apesed, first 
EEB4' 30 4 BSBW CNXSCLUB— FORK ; Release control b hy 
33 64 +4 5 MOVAL CLUBSL_CSBQFL(R4),R3 3; Point to head ot. E38 List 
2 ; D 6 10$ MOVL ¢ BS SY L(R3) ,R3 ; Advance to next C 
4 D1 CMPL R5,R 3; Done yet t? 
—E 13 BEQL 90§ - 3 Branch when don 
36 1C AG «611~—CEO 208: BBS #CLUBSV_UNLOCK, - 3; Branch if unlock requested 
CLUBSL_FLAGS(R4) ,80$ 
EE 60 AS 11 «€1 BBC #CSBSV SEL ESTER - ; Ignore unselected nodes 
: CSB Me STATUS (CR §,10$ 
E9 60 A306 10~—S—s‘«éE0 BBS #CSBSU_LOCKED, - ; Branch if already locked 


CONMAN - Cluster Configuration Manager 16-SEP-1984 00:26: AX/VMS Macro V04-00 Page C 
v04-000 LOCK_NODES - Obtain Coordinator Lock on eat 8:69:38 SYSLOA.SRCJCONMAN.MAR; 1 . (3%) Vv 
11 764 CSBSL_STATUS(R3),10$ 
2760 AS 00 =E0 1188 765 BBS aeses0 LONG BREAK - ; Branch if long break has been seen 

1168 3766 CSBSL_STATUS(R3),60$ ; and unlock everything 

EE92" ; 1168 37 BSBW © CNXSACLOC_WARMCDAP_CSB 

gE F* 11 - 7 8 BSBW Tae SOURCE _CHECK ; Watch out for exhausted resources 

05 50 5 11 8 BLBS RO, ; Branch if memory ayatlaple 

EE89" 1174 3770 BSBW 1 aaa tedl ; Wait a second, saving R 

DE 11 1100 ag BRB 0$ ; Restart scan 
50 9 9A 1179 4g 30$: MOVZBL #CLMCNXSK_FNC_LOCK,RO ; Facility spect its function code 
OI 30 117C 3774 BSBW INIT_STD_ASG : Standard CDRP initialization 
4C AS) 9B'AF «6099E «(117F «3775 MOVAB B*BL5 LOCK MSG, - ; Message building routine 

1184 ak: CORPSC_MSGBLD (RS) 

EE79° 30 1189 of F BSBW CNXSSEND_MSG_CSB ; Send message 
1187 58 : We are resumed here when the response message arrives. 
1187 3780 ; Registers contain: 
1187 re) : RO: Status 
1187 37 ¢ 3 Re: Address of message buffer 
1187 3783 ; R3: Address of CSB 
1187 3784 ; R4: Address of PDT 
1ie0 78s 3 R5: Address of CDRP 

015¢ 30 1187 3787 ° BSBW  CNXS$PROCESS_RESPONSE =; Deallocate storage, fetch status 

05 50 =€9 BF os ree BLBC RO,80$ ; Branch if ACK not received 
1150 oy : Setup data to Lock node whose CSB is R3 

EE70" 30 118D 19¢ : BSBW § CNXSMARK_LOCKED ; Mark CSB locked 

BD 11 BP 4 ay BRB 10$ ; Continue with next CSB 
00B1 31 1182 P82 80$: BRW UNLOCK_ALL ; Exit from transition 
74 B4 17 1195 3797 90$: JMP @CLUBSL_RET1(R4) ; Return to caller's caller 
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FUNCTIONAL DESCRIPTION: 
This routine builds a me 
The standard message bui 
header. 

CALLING SEQUENCE: 


JSB BLD_LO 
IPL is IPL$_SC 


INPUT PARAMETERS: 


CK_MSG 
$ 


R35: Address of CS 
R4: Address of PDT 
R5: Address of CDRP 
CORPS$L_VAL1(R5): 
5) 
5) 


R 
CDRPSL_VAL2(R 
CDRPSL-VAL3(R 


CDRPSL_VAL4(R5): 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
RO and R1 are destroyed 


Sete Se Ge Ge Ge Ge Ge Se Ge Ge Ge Ge Ge Se Se Ge Ge Ge Se Ge Ge Se Ge Sse Ge Ge Ge Ge Ge Ge Sse Sse Sse Ge Se tsetse Vse Bete 
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BLD_LOCK_MSG: 
Bw 


NAME WN OB OONAUE WIN 9 OO NOAUE WIN) OO ODNAUE WN 0 OONOAUE WN —O0 


0.009 00 00 CO. 00.00 0 C0 Gd GO.G0 G9.G0 GO GO GO GO G2 GO CO CD G9 GO 00 Gd GO GO GO Gd Go Gd G9 GO GO Gd GO G9G2 G9G0 G0 G900G000000000 ~J 
PRE RREES FWWWWWIWIWIWIWIWIIIRONINUPINNUNININ 2 SS BS IQ DOO 


: Transition ID (from CL 
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-SBTTL BLO_LOCK_MSG = Build Coordinator Lock Request Message 


age requesting the coordinator lock. 
n 


s 
ding routine is used to build the message 


R2: Address of pessege buffer 


Byte 0 contains facility code (negated for response 

Byte 1 contains edly specific function code 
$L_CUR_XTN) 

Byte 0 contains transition phas2 (from CLUB$B_CUR_P 

Byte 1 contains transition code (from CLUB$SB_XTN_CO 

Byte 2 contains success/failure flag 

Byte 5 contains reply code 

Address of CSB to describe 


8S BLD_STD_MSG : Fill in standard fields 
9B MOVL  CSBSL_CCUB(R3) ,RO : Address of CLUB 
OF MOVG CLUBSO CUk_TIME(RO), - : Fill in transition time-stamp 
a we CLMLCKSQ_XTN_TIME(R2) 
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LOCK = Lock request received SEP- 
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=z 
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: TRANS - 
LUBSL_FLAGS(R4), 208 
Abandon ony timeout in progress 


~ R4) ; 

MOVAB LUBSB rok BLOCK(R4),RO ;: Address 
BBCC #CLUBFRBS$V_FKB BUSY, - ; Branch 
CLUBFKBSL_STATOS (ROS + 3 busy an 
REMQUE CLUBFKBSB-FORK_BLOCK(RO).RO ; Re 


of transition fork block 

f fork block is not 
d mark no busy 

move from queue 


0 St 
03 1C AO 8600 
50 60)—Ss«OOF 


s 
C 
134 -SBTTL CNXSRCVD_LOCK = Lock request received 
HA e 
VA s : FUNCTIONAL DESCRIPTION: 
11A 2$ : This routine is called when a lock request message is received. 
11A : 3 A response must be sent which ACKs or NAKs the request. The 
134 28 : request is NAKd if this node is already locked or in transition. 
114 60 : CALLING SEQUENCE: 
11A e : JSB CNXSRCVD_LOCK 
a o7 3 IPL is IPL$_SCS 
1143 865 : INPUT PARAMETERS: 
1145 Be : Re: Message address 
11A5 508 5 R3: CSB of sending system 
11A5 +3 : R4: POT address 
1143 ao 3 RS CORP address (uninitialized) 
11A5 ere : OUTPUT PARAMETERS: 
11A5 3873 ; 
He ca 
1105 Bre > COMPLETION CODES: 
11A5 3877 ; 
lias 3879 ps 
1A 80 : SIDE EFFECTS: 
11A5 § : RO-R5 may be destroyed. 
Iie 364° 
11A5 3885 CNXSRCVD_LOCK:: 
52 43 148 § PUSHL R : Save needed register 
EE56° QO 1A BSBW CNXSINIT_CDRP ; Initialize the CORP for the response 
54 644A DO 11AA 3 MOVL CSBSL_CLOB(R3) ,R4 3; Address of CLUB 
04 BA 111A POPR #*M<R2> ; Restore message address 
50 68 AS OC A2 (C3 118 0 SUBL3 CLACNXSL_XTN_ID(R2), = ; Update largest transaction seen - 
11B 91 ct BSL_MAX_XTN(R4),RO ; status is only interesting result 
65 18 118 38 BGEQ 1 : No update needed 
68 AS OC A200 18 37 MOVL Sat hag ee eens >, ~ 3 Update local information 
63 1C AS 8 6©13.~«©€1So*d118 95 BBC acLUBSO INIT, - 3 Branch if initialization not 
11¢ %6 CLUBS$L_FLAGS(R4),20$ : complete and NAK request 
SE 1C AG «61D~SC# 11¢ BBSS aclu q ITION : Branch if busy and mark us busy 
11C¢ 
11C¢ 
11D 
11D 
11D 
11D 
11D 
11D 
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; Initialization for accepting lock request and beginning new transition 


+ 


Transition number is invalid. 
Lock request will be rejected. 
Request that status be send to remote node. 


0$: BISL2 #CSBSM_SEND_STATUS, - ; Send status request 
CSBSL_STATUS(R3) 


: Common reject point 


BOs Ge Ge Ge te 


60 AS 04000000 8F C8 


D 4 
CONMAN = Cluster Configuration Manager 16-SEP-1984 00:26: AX/VMS Macro V04-00 Page 85 
v04-000 CNXSRCVD_LOCK = "tock request received amt 8b 35938 SYSLOA.SRCJCONMAN.MAR; 1 . B) v0 
11D ; 
E25° 30 1138 S BSBW CNXSINIT_CSBS ; Initialize all CSBs for new transition 
1C AG 90020008 $F CA 112 : BICL2 ties tat tT ; Clear unlock flag 
50 18 AS DO IIE 1 MOVL CLUBSL_LOCAL_CSB(R4),RO ; Address of local CSB 
60 AO 00020000 BF ¢ 15 36 BISL2 acaGen sCLECTED. ~ ; Mark local node SELECTED 
60 A3 00020000 BF C8 Viet aie BISL2 AESBER SEL TER - 3; Mark coordinator SELECTED 
48 AG OC A2~ 00 115 318 MOVL Stine XTN_ID(R2), = ; Update local information about 
11FC 391 CLUGSL COR_XTN(R4) : transition 
4C AG) «644C AS ODO SC Ft 318 MOVL CSB t CSIOTR3), = 3; CSID of coordinator 
1 91 CLUBSC_CUR_COORD(R4) 
58 AG) 611 A2) «—90-s«1201+=S—s 33920 MOVB CLMCNXSB_XTN_CODE(R2), = ; Transition type 
1206 3921 CLUB$B_COR_CODE(R4) 
59 a4) S10 A2) so 90s«*1206 «39 § MOVB CLMCNXSB_XTN_PHASE(R2), = ; Transition phase 
1 9 CLUB$B_COR_PRASE (R4) 
50 A460 O14 A207 Od 924 MOVQ CLMLCKSQ_XTN_TIME(R2), - ; Transition time-stamo 
1 925 Natt cOR TIME (R4) 
5c a4) CO 553)—Ciés ) § MOVL R3,CLUBSL_COORD(R4) ; CSB of coordinator 
64 AS 66 A4 BO 1214 39 MOVW CLUBSW_FIRST_INDEX(R4), = ; Initialize CSID allocation context 
1219 3928 CLUBSW_NEXT_CSID(R4) 
01 DD 1219 3929 PUSHL #1 3; Accept request 
OA 11 1218 3930 BRB 30$ 
1210 3931 
121D 338 
121D 39 
1210 3934 
: D , 5 
ue 
1358 3989 
1 940 
1 941 
1 ag 
122A 394 
122D 3944 
1231 3945 


VPOPORIPOPINONONY 2 IO 


0 OD 08: PUSHL #0 3; Reject lock request 
50 0 SA 0$: MOVZBL M#CLMCNXSK_FNC_LOCK,RO =; Facility specific function code 
oopc §=«-: 330 BSBW CNXSINIT_STD_ : Init CDRP for standard response 
36 AS =6BEOUFS6 CVTILB (SP)+,CORP$L-VAL3+2(R5) ; Store success/failure flag 
eocc’ 31 BRW CNXSRESP_FORGET ; Send response and forget it 


E 4 
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~SBTTL CNXSCHECK_UNLOCK = Check UNLOCK flag 


o 
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FUNCTIONAL DESCRIPTION: 
Test the UNLOCK flag in the CLUB. If it is clear, return to the caller. 
If it is set, remove the caller's PC from the stack, and branch to UNLOCK_AL 
This will eventually return to the caller's caller. 
; CALLING SEQUENCE: 


JSB CNXSCHECK_UNLOCK 
IPL is IPL$_SCS 


INPUT PARAMETERS: 

; The CLUBSM_UNLOCK bit CLUBSL_FLAGS is the primary input 
: OUTPUT PARAMETERS: 

: R4 contains the address of the CLUB 

: COMPLETION CODES: 

: NONE 

; SIDE EFFECTS: 

NONE 


CNXSCHECK UNLOCK: : 
MOVE 
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PAA. AN.A.A. A AAA AAPA. AA AMAA AM AMAA PANAMA AMA ALAM A AA ANS 
WOOO OOOOOODOOOOOOWNOvOD 
0909090009 C0 O98 SIN NSN OO 
NOUS WN ($$ O OONAUS WOO 
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54  Q0000000'GF oD CLUSGL_CLUB,R4 ; Get address of CLUB 
011C Ad 11+~«O€C BBS #CLUBSV_ONLOCK, - ; Branch if unlock is request and abort 
CLUBSL_FLAGS(R4),10$ : this transition 
05 RSB 
5E 04 CO ADDL2 #4,SP ; Remove caller's PC 
00. «(11 BRB UNLOCK_ALL ; Abort transition and return to caller's ca 
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-SBTTL UNLOCK_ALL = Release Coordinator Lock on ALL Nodes 


FUNCTIONAL DESCRIPTION: 


This routine releases the coordinator lock on all nodes. 
A breaking Link counts as a successful release of the lock. 


$B 


J 
IPL is IPL 
INPUT PARAMETERS: 


CALLING SEQUENCE: 


UNLOCK ALL 
$ SCS 


CLUB$B_CUR_CODE gives transaction type 


NONE 


NONE 


SIDE EFFECTS: 


OUTPUT PARAMETERS: 


COMPLETION CODES: 


RO-R5 are destroyed 


CNXSCHECK QUORUM 
G*CLUSGL _C 


#CSBSV-LOCKED, - 
CSBSL_STATUS(R3) ,5$ 
f ,CLOBSL_COORD(R4) 


R 
COMPLETE _MSG,RO 
CNXSCONF IG_ CHANGE 


#CLMCNXSK_UNLOCK, - 
CLUBSB CUR PHASE (R4) 
CNXSSCAN _CSBS 
RO UNLOCE NODE 


OCKED 
STATUS CAS) 40$ 
) 


CLUBSL~COOR 


LUB,R 
CLUB$L_LOCAL_(€SB(R4) .R3 


CLUBSC_LOCAL cSBiR ,- 
OTR 


Adjust dynamic quorum flag, hang if no quo 
Address of CL 

Local CSB address 

Branch if stil\ locked 


Is local system the coordinator? 

Branch if not coordinator 

No CSB address for message 

Cluster state transition complete message 
Make this state known 


Set phase to UNLOCK 


Iterate over all CSB's 
Branch when done 
Branch if a cluster member 


Roquet tatus for non-cluster nodes 
nforming them of this nodes’ new status 
Branch if not locke 


Is soca) aysten the 
coordinator? 


: Branch if not coordinator 


Q 
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aiuste RP onic 


ite NCRECK 


#CLACNXSK FNC -UNLOCK,RO ; 


= eee 
fs 
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NXSSEND_ FORGET 
0$ 


meh 


; Branch if local CSB 


; Branch if connection really 
roken 
; Get a CDRP 


; Watch out for qudeusted resources 

; No me memory ava 

b oeee es speci tc function code 
CDRP for standard message 

gq message and forget it 

; Branch to common exi 


; Output ABORT message only once -- when processing local node 


60 0 508: CLARE 


MOVAB 


BSBwW 
¢ : Common exit 
6 Sos: BSB 

6 
BRW 
79 40$: RSB 


72 50$: BRW 


RS 
UNLOCK _MSG,RO 


CNXSCORF 1G. CHANGE 


CNXSMARK_UNLOCKED 
CNXSSCAN_CSBS_FORK 


CNXSSCAN_CSBS_RETRY 


; Mark CSB not locked. 


No CSB address 
Abortin transition message 
Make this state known 


If the CSB 


is deleted, R3 is previous List entry 


+ Fork and then continue scan 


; Delay and then resume scan 
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-SBTTL CNXSRCVD_UNLOCK = Unlock request received 


* 
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FUNCTIONAL DESCRIPTION: 


This routine is called when an unlock request message is received. 
The node is unlocked. No response or immediate acknowledgement is sent. 


CALLING SEQUENCE: 


JSB CNXSRCVD_UNLOCK 
ieL is IPL$_SCS ~ 


INPUT PARAMETERS: 
Rg: ($86 i Aa. s+ system 
POT oddress 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 


RO-R5 may be destroyed. 


Be Se Se Se Ge Ge Se Ge Ge Se Ge Se Ge Ge Ge Ge Ge Ge Se Ge Se Ge Ge Se Ge Se Ge Se Ge Se 
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CNXSRCVD_UNLOCK: 
BSBw ‘nSG CHECK ; Validate message 
BSBu CNXSDEALL_MSG_BUF_CSB ; Deallocate message buffer 


Right here, all nodes have been unlocked. 
May need to start up some activity here. 


intock NODE : 
CMP CLUBSW_VOTES(R4) 3; Is there a quorum? 
usw “QUORUM(RSS — 
BGEQU ; Branch if y 
BBC ters neg HUTDOWN, ; Branch if rot in shutdown mode 
UBSL_ Foauseney: 10$ 
BUG_ CHECK OPERATOR, FATAL ; Finish cluster-wide shutdown 
10$: BBCC #CLUBSV_ADJ_QUORUM : Clear quorum adjustment flag 
cLUB L_FLAGS(R4) ,208 
20S: MOVB actR NRSK_IDLE ; Set phase to IDLE 
cut rHASE Ray 
BBCC patty : Clear transition flag 
CLUBSL L FLAGSERAD, Nhs 
30$: BSBW UORUM’ 3; Check dynamic qyorus 
BRW START HE eReous : Keep the home fires burning... 
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FUNCTIONAL DESCRIPTION: 


AX/VMS Macro V04-00 


Process a reponse message by deallocating the message buffer 
and CORP 


Return status indicating whether the connection broke, the 
response was an ACK, or the response was an ACK. 


CALLING SEQUENCE: 


S CNXSPROCESS_RESPONSE 
L is IPL$_SCS 


INPUT PARAMETERS: 


of message buffer 
of CSB 


Address of PDT 
Address of CDRP 


OUTPUT PARAMETERS: 
Address of CLUB 
COMPLETION CODES: 


ss) Response was ACK 
re) Response was NAK 
re) Connection broke 


SIDE EFFECTS: 
R1, R2, and R5 are destroyed 


LEAF 
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CNXSPROCESS RESPONSE: : 
BLBC 


SSN NNO 
DWOONOUS WN O00 


ae 
So 
as 
ee 


POPPI OP PA AAPAA AA AA AA AA AAAA AAA AAPA AAA AASAASAASOSASAAASOSASS Mm 


SFU FN FN FG FG FN FNL TEE TN FFU TEU ETT TREE ETT ETN ETE TEEPE ITU TEER ETE CTE CTU ECTU CTE CTU CTU CTU CTL TU CTU CTU CTE TUETUCTUCTOCTOCTUCTOCTUCTUCvECTUCTOCvOrviC ys 


#2,R 
CSBSL_CLUB(R3) .R4 


a at a ed td a ts a a tt 4 3 9 4 4 ss = 2s ss 4 - — 9 2 2) 2 os as ts - 4s 2 2 as ts a zw 


CHAP IPIPIPIPDPIPIPIPIPIPIPPIPIPIPIPIPIDPIPITPUPIPIPIPOPIPIPIPPINIPIPIPIPIPIPUPINIPINPIPIPIPOPIPIPIPIPUNIPYD 


PREPPED 
cc cee ee me me ee el me me ce Se ee ee ed ed od od dd dd ds 3 


‘ 
i 
; 
; 


WMewn—Oo 


Sr= 


Error sending message 
Save response 

Recycle warm CDRP 
Restore response ACK/NAK 
Branch to common exit 


Save CSB address 
Address of CDRP 
Deallocate CDRP 
Restore CSB address 
Return otetys code 
Address of CLUB 
Return to caller 


SYSLOA.SRCJCONMAN.MAR; 1 
-SBTTL CNXSPROCESS_RESPONSE = Process simple response message 


J 4 
C - fi { i) =SEP- 126: 
vO0~000 INIT STBMSG = Pommon CORP taitializatio ‘S-sepaloa, besbesee LevsvOA.caeitoumtncwar:1 29° (2h, 
SBTTL INIT STD_MSG = Common CORP initi ize} for standard message 
SBTTL CNXSINIT-STD_RESP = Common CDRP initialization for standard response 
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FUNCTIONAL DESCRIPTION: 


This routine initializes most of the gone fields used by the standard 
message build routines. Two entry points are provided -- one for 

normal messages and one for respo ponees. 

These rout nes are provided for use in conjunction with the BLD_STD_MSG 
message building routine. 


CALLING SEQUENCE: 
438 aety 


UFWN—O NAM 


Sete Se Se Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Se Ge Se Se Se Ge Ge Se Se Se Se Ge Ge Ge Ge Ge Ge Ge Ge Se Ge Ge Ge Se Se Se 
ow 
=< 


INPUT PARAMETERS: 


RO: cweey e B pees} tied data 
ibe Facility specific function code 
: ACK byte data (INIT_STD_MSG only) 
Byte REPLY byte data (INIT_STD_MSG only) 
R3 Address of 
° R4 Address of 


LUB 
CLUBSL_CUR_XTN(R4): Current transition id 
CLUB$B_CUR_PHAS SE(R4): Current transition phase 
CLUBS$B-CUR-CODE(R4): Current transition code 
RS: Address of CDRP 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 


RO and R1 are destroyed 


DODODOOODOOOOODOOODOODODOOVOOODOOONOODO 
Ol el a el ed el ed 


ee ee ee ee ee ee ee ee ee ee ee ee oe ee ee ee ee ot ee ee ee oe ee ae  Y 
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CN 
cc 
cs 
cs 
cs 
cs 
Cs 
cs 
cs 
Cs 
Cs 
cs 
cs 
cs 
Cs 
cs 
cs 
cs 
Cs 
Cs 
Cs 
Cs 
cs 
C$ 
Cs 
cs 


, »ENABLE 1SB 
, CNXSINIT_STD_RESP:: 
51 81 8F 90 MOVE”  #<CLSMSGSK_FAC_CNX ! = ; Facility message code 
50 es D nee” 6 CL RASGSR. “RESPMSG>.RI : : with res nee top as dee 
: Ignore order 
38 11 BRB 6 . ° 

1 41 INIT_STD_MSG: 

51 01 90 1 4 Aove #@CLSMSGSK_FAC_CNX,R1 : fact ttt message ¢ de 

2C AS) 4 1 45 108: CLRL CORPSL_VAC1(R5) ; alize other elds 


K 
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v04-000 CNXSINIT. STD RESP = Common C RP initiali Sets 7 4 ‘68: § SYSLOA. SRCJCONMAN.MAR; 1 ” (46) Sy 
A 1318 4244 MOVB j-coRe L “tat (R 3 Facility identification code RE 
gf 3 24 $9 1 4245 MOVB 0,¢ prac =V tei eR : Facility specific code RE 
30 A 48 AG OD é 4g MOVL agin re ; Current transition ID + 
34 aS 650 00 ! ? ‘3 MOVL RO,C RPSLVAL i oi : Store byte of e as eck, riqt¢. H+ 
Py as re e 
3405 S9 AG 90 ! , ? MOVB APSE “tenes ee @ ; 7 ig BAF. phese” - 4 
35 a5 SB AG 90 1 4 MOVB CLUBSB"CUR CODE (RG), - ; Current transition code SE 
1 & CORPSL gyalse (R5) s¢ 
46C AS) 39°AF) «69E 1 4254 MOVAB B*BLD STD_MSG ; Standard message build routine s¢ 
1 4255 CDORPSC *MSCBL SERS) SC 
05 4 $ RSB 43 
1339 4258 .DISABLE LSB HH] 
SE 
SE 
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-SBTTL BLD_STD_MSG = Build Standard Message from CDRP 
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FUNCTIONAL DESCRIPTION: 


This routine is a common message build routine that fills in 

the common message header from data in the CDRP. 

There is no Copegeence upon the contents of the CLUB in building 
the message. This means that this routine is safe to use for 
messages that are queued and forgotten and which can be sent 

at a later time when the state of the world has changed. 


CALLING SEQUENCE: 


JSB BLD_STD_MSG 
IPL is IPLS_SCS 


INPUT PARAMETERS: 


R2: Address of message buffer 
R35: Address of CS 

R4: Address of PDT 

RS: Address of CDRP 


CDRPSL_VAL1(R5): Byte 0 contains facility code (negated for response 
Byte 1 gonteing ody Bh specific function code 
CORPSL_VAL2(R5): Transition ID (from CLUBSL_CUR_XTN) 
CORPSL_VAL5(R5): Byte 0 contains transition phase (from CLUB$B_CUR_P 
Byte 1 contains transition code (from CLUB$B_XTN_CO 
Byte ; contains success/failure flag 
Byte 5 contains reply code 
OUTPUT PARAMETERS: 
NONE 
COMPLETION CODES: 
NONE 
SIDE EFFECTS: 


RO and R1 are destroyed 


NAME WN 9 OO NAN WN SO ODNA UE WN 0 OD NOUS WO 


PRD AF Sted 84 hat tg tet PRR A A By Oe ter 5 


LD_STD_MSG: 
MOVB 


me ed ad ed od dd dS dd Sd 3 a 


PRE ESF FAWN NWA AAAAHI AAA AAA A. AAA A AAA. A. AAA. A AAA AA AAAI 


WANNA OOODOOO00000D0000000000 0000000000000 00 000000000000 
i tt Yt ot tt ot nt a a MARA AMAAAMAUAMAMUAAAAAMAAAAAAAMAeAdAddteneneeee 


ANEW CO OONOULS WN OS 


08 A2 2C AS 90 CORP$L_VAL1+0(R5), - ; Facility message / response code 
CLSMSGSB FACILITY (R2) 
09 A2 2D AS) 90 MOVB CORPS$L_VAL1+ R3). ~ 3 Facility specific function code 
CLSMSGSB_FUNC(R ) : 
1 ASSUME CLMCNX$B_XTN_PHASE ty CLACNXSL_XTN_ID+4 
1 ASSUME CDRPSL_VAL3 EQ CDRPSL_VAL2+ 
1 ASSUME CLACNXSB_XTN_CODE EQ CLACAXSS XTN_PHASE+1 
1 ASSUME CLMCNXSB"ACK™EQ CLMCNXS$B_XTN_CODE?1 
1 ASSUME CLMCNX$B REPLY EQ CLMCNX$B_ACK+ 
OC A2 30 A5 7D 1 MOVa CORPSL_VAL2(R5), - ; Standard information 


es 


, "000 Bub oder watt fro "97 $Fb= 1382 82: 89: § YSYSUOA. sae SPONRAN MAR: 1 eps (24) 


i 
MSG - B 
48 4317 CLMCNXSL_XTN_ID(R2) 
tg 2316 RSB ee 
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~SBTTL MSG_CHECK = Standard incoming message verification 
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FUNCTIONAL DESCRIPTION: 
This routine is called to per vere standard checks upon an 
incoming peseege. These checks may not be application to 
messages intit 

CALLING SEQUENCE: 


JSB MSG_CHECK 
IPL is IPL$_SCS 


INPUT PARAMETERS: 


ating or completing a transition. 


r 
K 
1 4 
1 4 
1 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 
1349 4 a! Message address 
1349 4 R3: CSB of sending system 
1349 4 : POT address 
3 4 ; RS: CORP address (uninitialized) 
13 4 2 OUTPUT PARAMETERS: 
1349 eeee R4: Address of the CLUB 
1349 6346 COMPLETION CCDES: 
1349 434 
1349 4348 NONE 
1349 4349 
1349 4350 ; SIDE EFFECTS: 
1349 $32) 
1349 4 25 RO-R1 may be destroyed. 
1349 4 : 
1349 4354 
1349 4355 MSG_CHECK: 
54 64 A3 DO 1349 4 2$ MOVL CSB$L_CLUB(R3) ,R4 3; Address of CLUB 
48 AG 0C A2) D1 «1340 «435 CMPL  CLMCNRSL_XTN_ID(R2), = : Check for inconsistency 
1 2§ 4 38 C UBSL_COR_XTN(R4) 
0B 12 1352 435 BNEQ 1 :; Bugcheck on inconsistency 
06 1C AS 1D €1 1354 4360 BBC #CLUBSV_TRANSITION, = ; Branch on inconsistency 
1359 4361 CLUBSL_FLAGS(R4), 10$ ; and bugchec 
59 AG) «610 A2—s«9—s«d1359— 6¢ MOVB  CLMCNXSB_XTN_PHASE(R2), - ; Save transition phase 
1 ze 4 ° CLUB$B_COR_PRASE (R4) 
wi ty 
135F 136 108: BUG_CHECK CNXMGRERR,FATAL ; Inconsistent message 
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-SBTTL UPDATE_QUORUM = Update Quorum Parameters in CLUB 


vO4~000 


ct 
vw 
on- 
> 
=—c 
zo 
co 
z5 


0 


3++ 

: FUNCTIONAL DESCRIPTION: 
Update ee gtugsY QUORUM, CLUBSW_VOTES, CLUBS$W_QDVOTES, and 
CLUBS$W_N fields of the CLUB at the conclusion of a fully 
evant ae ph stete change. 

CALLING SEQUENCE: 


JSB UPDATE QUORUM 
TPL is IPL$_SCS 


INPUT PARAMETERS: 
CSB'S in List with CSBSM_SELECTED bit set 
CLUB$W_NEWQUORUM is quorum 
CLUBSW-NEWQDVOTES is votes wastes to quorum disk 
CLUBS$V_QF_NEWVOTE is quorum disk membership flag 
OUTPUT PARAMETERS: 
R4 is address of CLUB 
CLUB$W_QUORUM is new quorum 
CLUB$W_VOTES is new number of votres present in the cluster 
CLUB$SW-NODES is number of nodes in cluster 
CLUBSV_QF_VOTE indicates that the quorum disk is a member 
COMPLETION CODES: 
NONE 


SIDE EFFECTS: 


WW ANNAN AIAN NINA ANA AANA 


PA_AERARAAAAAAAAA AAA AAA AAOAAAAAOAOASAASOSASOSSOSASAS Of 
AAEM WD COCO INIM UNWIN AWA NINN NAIA IAAI AANA 


AANA WWinwwa 


RO and R1 are destroyed. 
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9 

0 
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H a 

7 UPDATE_QUORUM: 
Oc 6B 8 HR #*M<R wi ; Save registers 

54  QO0000000'GF 0D 8 : Address of CLUB 
4 
4 


G6*CLU 
20 a4 «= O0A4 C4—i«é#@B MOV CLUBSW “REEQUDRUR (RA), - : Update cluster quorum 


ee ee ee eee ye YS S } mw 
Pe ee ee MUU UUUUUUUUUMUUUUAAAUARMUAAAAAAMUAAAUMeeeUeMeettetreteeeteeee 


6 
6 
$ LUB UM(R4) 
OOAE C4 46 A4~ BO 4 MOV itr te we UOOVOTES (RA). - ; Update quorum disk votes 
4 AQ BG 7 CLRW CLUBSUNODES (RG) : Initialize count of nodes 
2A4 B4 7 CLRW CLUBSW_VOTES(R4) : Initialize vote coun 
1¢ AS = =02000000 BF CA 7 BICL te enor BYOTE: = ; Assume no quorum aisk membership 
OA 1C AG 1A «C*? BBC CCURRP FEAGSTRCS Os, ; Branch if no quorum disk membership 
22 a4 «46 AG OA ADDW CLUBSU- =NEUODYOTES(RED, ; Count quorum disk in votes 
00 1 AS «619~—=COE2 ? BBSS arte 7” FLAGS (ROS 1 10s ; Mark quorum disk a member 
Ec68" 30 9 10$ BSBW ERXSSERN: CSBS ; Iterate over all CSBs 


¢c 5 
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OE 50 BLBC RO, 308 ; Branch when done 
08 60 A311 BBC ; Branch if not selected 
InCW ; Count this node 


ADDW W ; Count votes for this node 
RSB 


POPR #*M<R2,R3> ; Restore registers 
RSB ; Return 
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22 AG 0 A3 
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- Make node a cluster member 


ste 
ODE SEP=-19 SYSLOA.SRCJCONMAN.MAR; 1 0) 
13SAC 44 § -SBTTL ADO_NODE = Make node a cluster member 
13a 2e8B GS 
At 445 : FUNCTIONAL DESCRIPTION: 
AC cea} : Make the specified node a cluster member. 
AC ates : CALLING SEQUENCE: 
13AC 4445 : JSB ADD_NODE 
: ry: ert $ IPL is IPL$_SCS 
AC 4468 : INPUT PARAMETERS: 
13AC 4450 : R3: CSB of the node to be added 
: ve rit : CSBSL_CSID contains CSID for the node 
AC ca38 : OUTPUT PARAMETERS: 
: we 4t33 : R4: Address of CLUB 
13AC 1089 > COMPLETION CODES: 
13AC Pett : 
SRT SS Sage 
AC 4461 : SIDE EFFECTS: 
13AC 446 : The cluster vector is updated. 
15AC 4464 ; The CSB reference count is incremented. 
13AC 4465 ; RO-R1 are destroyed. 
13AC 4466 ; 
VME fig 
13AC 446 3 ADD_NODE: 
6C AS) 96 13AC 4470 INCB CSB$B_REF_CNT(R3) ; Bump reference count to nail down CSB 
60 AS 02 CB 13AF 4471 BISL2 #CSBSA_MERMBER, - 3; Mark the node a cluster member 
1 447 CSBSL_STATUS(R3) 
50 4C A3 7 1 3 447 MOVZWL SBSW_CSID_IDX(R3) ,RO ; CSID slot index 
1 1 4474 BEQL : Branch if 0 -- invalid index 
00000000 * GF B1 1389 4475 CMP RO ,G*CLUSGW_MAX INDEX 3; Valid index 
1 13CO0 447 BGEQU : Branch if invalid index 
51 Q0000000'GF DO 1 3 447 MOVL Fart Vest -CLUSVEC RI ; Address of cluster vector 
6130 05 13C9 447 TSTL (R1)CR 3; Is slot free? 
g 19 13CC 447 BLSS 99s : Branch if slot in use 
6140 DO 13CE 4480 MOVL R3,(R1) CROJ ; Store CSB address in slot 
54 6G AS 00 1 D3 4481 MOVL csBst CLUB(R3) .R4 : Address of CL 
05 60 ad OO EO 1306 44 ¢ Bas #Cs8 Q0_CLUSTER, - ; Skip ref time update if remote 
13DB 44 CSB$L_STATUS(RS) ,5$ : node is already a cluster member 
7403 3C AG 7D D 44 4 mova cLUBS aerate GRA. - : Update reference time 
05 60 AS 18 €1 13EC 44 § 5$: BBC ecsest 4Oe = ; Branch if not the local node 
1365 44 CSBSL_STATU {n3) ,108 
60 AS 4C AS DO 13E5 44 3 MOVL cSBst SID(R3), = ; Store local CSID in CLUB 
05 60 AS 6000~—Cé#€C*?D i EA t 10$ BBC StSBSV-TONG” SIDR) ; Branch if no long break seen 
13EF 44 : (spe Stas ERE) Sos : 
00 1C AS «617)—COE2 «(OC NSEF 8644492 BBSS #CLUBSV_LOST_CNX, - ; Mark cluster connection lost 
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13F4 «644 CLUBSL_FLAGS(R4) ,20$ 
05 i res 208: RSB * 


F 
1 i 4496 90$: BUG_ CHECK CNXMGRERR,FATAL ; Consistency check 
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-SBTTL REMOVE_NODE = Remove a node from the cluster 
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FUNCTIONAL DESCRIPTION: 
Remove the specified node from the cluster 
CALLING SEQUENCE: 


JSB REMOVE NODE 
IPL is IPL$_SCS 


INPUT PARAMETERS: 
R3: CSB of the node to be removed 
OUTPUT PARAMETERS: 


R3: If CSB is deleted, the sergents of back pointer cell. 
If CSB is not deleted, R3 is preserved. 


COMPLETION CODES: 
NONE 
SIDE EFFECTS: 
The cluster vector is updated 


The CSB reference count is decremented. 
RO-R2 are destroyed. 


—OOONAULSUM—OOew D-—- 


FD Se Be Oe Oe Oe Oe Oe Oe Oe Oe Os Be Oe Se Be Oe Se Se Se Oe Se Se Se Se Be Se Be Se Se Se ee 


; Save register 

; Address of CSB 

3 messegs for removing node from cluster 

; he world the node is gone 

CSBSV_MEMBER, - ; Mark the node not a cluster member 
CSBSL STATUS(RS) , 90$ ; *** Is this right? 

BISL2 #CSB penoyee - ; Mark the node removed 


CSBSL STATUS 

MOVa CLUBSG_LST_TIME(R4), = ; Update reference time 
CSB REF T TING (Ro) 

MOVL CSBSL_CLUB(RS5) ,R4 3; Fetch address of CLUB 


Tell quorum disk meneper to skip a read cycle since a node has just been dropped 
from the cluster -- the removed node may still have a chance to write. 


BISL2 ocr gen QF FATLED_NODE. 
CLUB 4 FLAGS (R 5 
BICL2 ertuee QF _DYNVOTE, - ; Stop dynamically counting the quorum disk 


C ues FLAGS (R4) : until remote node can sense us 
MOVZUL USID_IDX(R3) ,RO ; CSID slo index 


PUSHR #*M<R4,R5> 
MO 


R 
w*f AILOVER_MSG,RO 
BBY CNXSCONF 1G” CHANGE 


Bee ee te te eee 
— 
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3 Set bit requesting that a read cycle be 
; kipped 


PEPPERELL PPP EEE PPP PEEP PEEP PEEP PEEP EPP PEPE PEEP PEE 


FP OOD NA NEW 9 OD NAME WIN = OOOO NEW  O OO NAUE WP 
< 
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BEQL Branc 0 -- invalid index 
CMPW RO, G*CLUSGW_MAX INDEX Valid index 
BGEQU f : Branch if invalid index 
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REMOVE _NOD 
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6 5 
16S 
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MOVZWL CSBSW_CSID_SEQ(R3), - 
cates 

MOVL R3,R 

BSBW CNXSDISC_REMOVE 

BSBW SEND _JBCAS 

BSBW CNXSBECREF CNT 

MOVL R5,R 

POPR #M<R4,R5> 

RSB 

BUG_CHECK CNXMGRERR,FATAL ; 


END 


faa 


; Address of cluster vector 


ranch if things are A, ae 
tore old sequence number for reuse 


Address of cs9 

Break connection to node that has been rem 
Tell the job controller that the node is g 
Decrement reference ount * ybomee: delete 
Address of th aieres ous ¢$ 

Restore R4 and R 


er slot consistent w gh CSB 


Consistency check 
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$SBAS = 0000000 LMCNXSK_RP_TRNSTS_PH1 s 

$301 SPL 2 3090003 LRENKSKRPCTRNST “PHIB : 

SSGENSW = 0009000 CLACNXSK-RP-TRNSTS_PH z 

$HIGH = CLMCNX$K_UNCOCK = 

SSLIMIT : CLACNXSK-XTN_FORM = 

$$LOW s CLMCNXSK-XTN- JOIN s 

SSMNSW s CLACNXSK-XTN_QUOR s 

SSMXSW = CLACNXSK-XTN_RECONF 1G = 

ADDNODE _MSG x CLMCNXSL-XTN-I = 

ADD _NODE 2 CLMCNXSV-RP_TRNSTS_CMT s 

ADJOST R CLALCKSQ-XTR_TIME = 

ANALYZE PHASE R CLANCOSS_ 515 TERIO = 4 
BLD_DESC_MSG m CLMNODSL-CSID z 4 
BLD-FORM_MSG AR CLMNODSQ" SWINCARN s ¢ 
BLD-JOIN_MSG R LMNODSS_SYSTEMID = 
BLD-LOCK"-MSG R CLMPROSB_FLAGS = 
BLD-QUOROM_MSG & CLMPROSB_FSYSID = 1 
BLD RECONFIG_MSG mR CLMPROSB_NODEMAP s 7 
BLD: STD_MSG a CLMPROSL_FMERIT s ¢ 
BLD- TOPOLOGY _MSG R LMPROSM_QF VOTE = 
BLD-VEC_MSG OO00F 04 R CLMPROSQ_ CURT IME = 
BUGS_CLOEXIT eeeneere x CLMPROSQ_F TIME = 
BUGS_CNXMGRERR tereenee =X CLMPROSS_FSYSID = ° 
BUGS OPERATOR tererene xX CLMPROSS_NODEMAP 2 
BUILB_STS_MSG 3 CLMPROSV_QF VOTE = 
CORPSC_MSGBL = CLMPROSW_MEASEQ s 1 
CORPSL_RSPID = CLMPROSW_NEXT CSID = 14 
CDRPSL_V = CLMPROSW_QOVOTES = 1A 
CORPSL-VAL = CLMPROSW- QUO = 16 
CORPSL_VAL = CLMSTS$B_FLAGS = 
CORPSL_VAL4 s CLMSTS$B_QD1SK = 
CORPSL-VAL = CLMSTSSL_MAX_XTN 2 C 
CORPSL_VAL = CLMSTSSM_CLUSTER z 1 
CORPSL-VAL8 = CLMSTSSM_QF ACTIVE = be 
CLACNXSB_AC = CLMSTSSM_SHOTDOWN = 
CLMCNX$B_REPLY s CLMSTS$Q_FTIME = 1¢ 
CLMCNX$B8_XTN_CODE s CLMSTS$SQ-LST_TIME = ee 
CLMCNX$B_XTN- PHASE = CLMSTSSQ_REFTIME = 
CLACNXS$K-DATA z CLMSTS$S_QDISK s 1 
CLMCNXSK_FNC_DESC 2 CLMSTS$V_CLUSTER = 
CLMCNXSK_FNC_ENTER = CLMSTS$V~QF ACTIVE = 1 
CLMCNXSK_FNC_FORM s CLMSTS$V—-SHOTDOWN = 2 
CLACNX$K-FNC_JOIN s CLMSTS$W-CQUORUM = 5 
CLACHXSK ENC LOCK z CLASTSS$W_CVOTES = 1 
CLACNXSK— FNC = CLASTSSUCLCKDIRUT 2 1A 
CLMACNX$K~FNC~ QUORUM s CLMSTS$W_NODES s 12 
CLMCNXSK~FNC_RECONF IG = CLMSTS$W~NQUORUM 2 1 
CLACNXSK-FNC- STATUS = CLASTSSW-NVOTES z 1 
CLMCNXSK—FNC~ TOPOLOGY = CLMSTS$W_QDVOTES = 1 
CLMCNXSK-FNC_TRNSTS = CLATOPSS -NODERAP = 1 
CLMCNXSK~FNC_UNLOCK 2 CLMTOPS$S-NODEMAP = 1920 
CLMCNXSK_ FNC” VEC s CLAVE CSW~ INDEX s 
CLMCNX$K_ IDLE E CLMVEC$W- SEQUENCE = 1 
CLACNX$K"LOCK s CLSMSG$B_FACILITY s 
CLACNX$K~PH = CLSMSG$B_ FUNC = 
CLMCNXSK~PH2 = CLSMSGSK-FAC_CNX = 1 
CLACNXSK-RP_TRNSTS_PHO = CLSMSGSM_RESPMSG = 0 
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CLUSGL_CLUB eeeeerer =X LUBSV_QF_ACTIV s 1 
CLUSGL CLUSVEC teeereee =X o3 LUBSY-BF DYMVOTE = if 
CLUSGWMAX INDEX eeeveree =X LUB VaOF FAILED NODE 3 D1 
CLUBSB_ CLUBPWF s LUBSV—QF “NEWVOTE s 1A 
CLUBSB_CLUF CB = CLUBSV_QF “VOTE z 19 
CLUBSB_CUR_C = cLUS ¥=QUORUM s 1 
CLUBSB_ CUR" PHASE = LUBS$V= SHUTDOWN 2 

CLUBSB_FORR BLOCK = CLUBSV—STS_PH z 
CLUBSB_FS¥SID s CLUBSV~STS_PH = 
CLUBSB_LST_CODE = CLUB SV ste Puls 2 DOA 
CLUBSB~LST~PHASE s CLUBSV"STS_PH : i ‘ 
CLUB$B_NODEMAP z CLUBSV STS PPHASE = ' 
CLUBSL- COORD = CLUBSV—TRARSITION = 01D 
CLUBSL_-CSBOFL = CLUBSV_UNLOCK 2 011 
CLUBSL_CTX z CLUBSW_ADJ_QUORUM = BAG 
CLUBSL-CT 2 CLUBSW_FIRST_ INDEX z it! 
CLUBSL—CUR_COORD = O CLUBSW_MEMSEG z AC 
LUBSL_CUR"XT = 00 CLUBSW_MSGCNT 2 SA 
CLUBSL FLAGS = 000000 CLUBSW_NEWGDVOTES = 46 
CLUBSL_FMERIT = 00000 CLUBSW_NEWQUOR 2 AS 
CLUBSL_FOREIGN CLUSTER = 000000 CLUBSW_NEXT CSID s $f 
CLUBSL_LOCAL_CSB s CLUBSW_NODES 2 4 
CLUBSL-LOCAL-CSID = CLUBSW_QOVOTES s A 
CLUBSL_LST_COORD = CLUBSW_ QUORUM s 
CLUBSL_LST_XTN z CLUBSW-VOTES = 

CLUBSL_| XTN = CLUBFKBS$B_FORK BLOCK = 

CLUBSL_RETT = CLUBFKBSL-STATOS 2 1 
CLUBSL_ = CLUBF KB$V_FKB_BUSY = 0 
CLUBSA_| s CLUBPWFSL-STAT s 1 
CLUBSM_LOST CNX 2 CLUBPwF $V s 9 
CLUBSM_QF _DYNVOTE = CLUF CBSB_RODEMAP s 
CLUBSM_QF “FAILED NODE = CNXSALLOC_CDRP_ONLY eeneeere § xX 0 
CLUBSM_QF “NEWVOTE = CNXSALLOC “WARMCDRP_CSB eeneeeee =X 
CLUBSM_QF “VOTE = CNXSALLOZAER eeeeneee xX 04 
CLUBSA_ s CNXSASSIGN_CSID eeeeeeee =X 
CLUBSM_ SHUTDOWN 2 CNXSBUGCHECK CLUSTER aeeeeeee =X 
CLUBSM_STS_PHO 2 CNXSCHANGE _QOORUM 00000226 RG 
CLUBSM_STS_PH1 z CNXSCHECK_GUORUM aeeeeeee =X 
CLUBSM_STS_PH1B = CNXSCHECK- UNLOCK 00001234 RG 
CLUBSM_STS_PH2 s CNXSCLUB_FORK eerereee =X 
CLUBSM_STS- PPHASE = CNXSCLU AIT eeneeeee =X 
CLUBSM_ TRANSITION s CNXSCONF IG CHANGE aeereree =X 
LUBSA_UNLOCK s CNXSCON_BREAK RG 
CLUBSO_C TIME 2 CNXSCON_ INIT RG 
CLUBSO—F TIRE = CNXSCON-NEWSYS RG 
CLUBSQ_LST_ TIME = CNXSOEACL_MSG_BUF _CSB eeneesee =X 
CLUBSO- NEWT IME = CNKSDEAL WARACDRP_CSB eeneeeee § 6X 
CLUBSO"NEWT IME_REF = CNXSDECREFCNT eereeeee =X 
CLUBSS_FSYSID s CNXSDIRVEC_ADJ aeeeeeee =X 
CLUBS$S_NODEMAP s CNXSDIRVEC-FILL aeneeeee =X 
CLUBS T~ QONAME = CNXSDISC_REMOVE eeeeeeee § xX 
CLUB$¥—ADJ_QUORUM s CNX$D ISK” CHANGE OOOOOIEF RG 
CLUBSV—BACROUT s CNXSFIX_EPID eeeerere =X 
CLUBSV—CLUSTER = CNX miT CORP eeeneeee =X 
CLUBSV~INIT s CNXSINIT-CSBS eeevenee §X 
CLUBSV=LOST_ CNX z CNXSINIT“SYD_RESP 00001309 RG 

UBSV=NO_F s CNXSMARK-LOCRED eerereee =X 
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NXSMARK_UNLOCKED tereeeee =X SBSV_QF_ACTIVE = 
SRERBERSHIP. CHANGE aa | SBSV—~QF-SAM s 
CNXSOPT eeneeeee SBSV-SECECTED = 
eee el a S000E ae" EE taba = Sh 
= 
CNXSPROCESS RESPONSE RG CSBSV-STATUS_RCVD 2 9 
NX CALE teeeeree x CSBSW~CSID_IBXx = 4 
NXSR eeeerere Ft tre $10_SEQ = 4 
NXSR NIT eeereeee CSBSW"LCKOTRWT = 5 
CNXSRCVD_DESC Ft le $ 5 $ 
CNXSRCVD_ENTER CSBSW_QOVOTES = 
XSRCVD_ 5 eeeu conn = ; 
CNXSRCVD_JOIN CSB$W_ VOTES = 
CNXSRCVD— DESCRTBE NODE F4B R 
CNXSRCVD_ PH DO_PHASE2 108 R 
NXSRCVD_ QUORUM DO- TIMEOUT 4 
CNXSRCVD_RECONF IG DYASC_FRK : 9 
CNXSRCVD- STATUS DYNSC~TQE = F 
CNXSRCVD_ TOPOLOGY EXESACONONPAGED eeeeeeee =X 
CNXSRCVD_TRNSTS EXESAL_TQENOREPT eeneeeee 8 Xf 
CNXSRCVD_UNLOCK EXESCLOTRANIO eeeeeere =X 
C VEC EXESDEANONPAGED eeeeenee =X 
CNXSRESOORCE CHECK eeneeeee = =X EXESFORK eeneeere § x 
CNXSRESP_FORGET eeeeeeee xX EXESFORK WAIT teeeeeee =X 
CNX$SSCAN~CSBS eeeneree = xX EXESGQ_SYSTIME eeneeeee xX 
CNXSSCAN_CSBS_EXIT eeeeeeee § xX EXESINSTIMG eennenee =X 
CNXSSCAN_CSBS_FORK teeeenee =X FAILOVER MSG eeneeeee =X 
CNXSSCAN_CSBS RETRY eeeeeeee §X FKBSB_FIPL ® 
CNXSSEND_ALL_ STATUS 00000275 RG FKBS$B_TYPE s 
CNXSSEND_ FORGET eeeeeeee =X FKBSK-LENGTH z 
CNXSSEND-MSG_CSB eeeeeene § xX FORM_CLUSTER 
CNXSSHUTBOWN 00000249 RG FORM_DESCRIBE 
COMPLETE MSG eereeree xX FORM-FINISH 
CSB$8_NODEMAP = FORM JOIN FINISH 
CSBSB_REF CNT = FORM- PROPOSE 
CSBSL-CLUB s INIT— CONTINU 
CSBSL-CSID s INIT“STD_MS 
CSBSL-SB = INIT~ TRANSITION 
CSBSL-STATUS = IPL$"SCS s 
CSBSL-SYSQFL = IPLE_SYNCH = . 
CSBSM_ CLUSTER s IPLS_TIMER = 
CSBSM_LONG BREAK = JOIN“ CLUSTER R 
CSBSM_MEMBER s JOIN-FINISH SR 
CSBSM_QF _ACTIVE z JOIN-LOCKED R 
CSBSM_QF “SAME = JOIN-MSG aeeenene 
CSBSM_REROVED s JOIN” PROPOSE QOOOOA4F R 
CSBSM_SELECTED = LCKSGB_STALLREQS aeeeeeee 
CSBSM_SEND_ STATUS s LOCK NODES 00001137 R 
CSBSM" SHUTDOWN = MEMREQ_MSG eeeeeeee 
CSBSM_STATUS_RCVD = MSG_ CHECK 3008 ne i] 
CSBSQ-REF TIME s POTSL_POLLSWEEP z p8 
CSB$S_NODEMAP = PRS_IPL eeeerere Xx 
CSBSV_CLUSTER s QUORUM_F INISH 00000880 R 
CSB$V“LOCAL s QUORUM_MSG eenenere =X 
ESB SV-LONG. BREAK : RECONF TG: CLUSTER 09000764 R 
= 
CSBSV_MEMBER = RECONF IG"FINISH $o000855 ® 
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. ped G_LOCKED 0000078E R 

: FIG IASG eenetere 

R CONE “PROPOSE EB R 
REMOVE NODE 88001 969 R 

REQJOIN MSG eerereee x 

SB$B_SYSTEMID = 8 

SBSQ_SWINCARN Pa 

SBSS_SWINCARN = 

SBSS_SYSTEMID = 

SCAN” R 

SCSSDEALL_RSPID eeeeeene =X 

SCS$GA_LOCALSB eeerenee =X 

SCSSGL_ tereeree x 

SCS$GW_PRCPOLINT eeeneeee =X 

SEND _JECHSG ereneeee =X 

SEND_PH 4 SFR 

SEND_PH2 1 R 

SEND STATUS 00 fe 

SNOSTS_MSG eeeeeeee =X 

$ss = 1 

START_LONG TIMEOUT 3 

START_ TIMEOUT 

TQESB_RQTYPE = 

TQESB_TYPE = 

TQESC_SSSNGL a 

TQESK_LENGTH s 

TQESL_FPC = 

TQESL_FR4 = 

TOESW SIZE = 08 

TRYFORM_MSG eeereeee §6X 3 
UNLOCK _ALL 00001246 R 
UNLOCK_MSG eeeeeeee = §6X 
UNLOCK _NODE BONO Tee ge 
UPDATE _QUORUM 001565 R 

weeeeecoeoceoescos + 
! Psect synopsis H 

PSECT name Allocation PSECT No. Attributes 

. ABS . ( ) ( 9.) NOPIC USR CON ABS LCL NOSHR NOEXE NORD NOWRT NOVEC BYTE 
SABSS$ ( ->) QO1¢ #1.) NOPIC USR CON ABS LCL NOSHR EXE R&D WRT NOVEC BYTE 
$$$04 ( -) g ( $°} NOPIC JSR CON REL LCL NOSHR EXE RD WRT NOVEC LONG 
$$$! ( $215.) ( 3.) NOPIC USR CON REL LCL NOSHR EXE R&D WRT NOVEC LONG 
$$$00 ( ) ( 4.) NOPIC USR CON REL LCL NOSHR EXE R&D WRT NOVEC LONG 

Pere ew eee en ee ere eww maewncs 
: \"Pertormance indicators ! 
Phase Page faults CPU Time Elapsed Time 
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Pass 52 :00:06. :00: ¢. 

Symbol table output 7:00:00. :00:01. 

Psect synopsis output :00:00. :00:00. 

Cross-reference output :00:00. 00:00. 

Assembler run totals 132 7:00:26. 747. 

The working set Limit was 1950 pages. 

154996 byte Yo$ pages) of 50 page memory were used to buffe intermediate goge; 

local symbols. 


r the 
There were i pages of symbol table space al Scaiee to hold iad non-local and ¢ 
$3 1 source Lines were read in Pass 1, produc "90° 
ne 


object records in Pass 2. 
pages of virtual memory were used to de 


macros. 


i ronors 


! Macro Library statistics ! 


eee mmm eee we m wwe remem meen ny 


Macro Library name Macros defined 
5 eepua : SVELOA 001 2CLUSTER ALO; 1 $ 
_8255$DUA28: (SYS.OBJJLIB.MLB; 1 
$255$DUA28: CSYSLIBISTARLET.MLB;2 5 
TOTALS (all Libraries) 24 


1876 GETS were required to define 24 macros. 
There were no errors, warnings or information messages. 
MACRO/LIS=L1S$:CONMAN/OBJ=0BJ$:CONMAN MSRC$:CONMAN/UPDATE=(ENHS$: CONMAN) EXECMLS$/LIB+LIB$:CLUSTER/LI6 
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